-- Logs begin at Tue 2022-01-11 13:34:29 UTC, end at Tue 2022-01-11 14:35:44 UTC. -- Jan 11 14:04:31.361104 dv-cinder-824131-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 11 14:04:31.368447 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 11 14:04:31.370399 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 11 14:04:31 2022] *** Jan 11 14:04:31.370399 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 11 14:04:31.370399 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 11 14:04:31.370399 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: nodename: dv-cinder-824131-3-iscsi Jan 11 14:04:31.370399 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: machine: x86_64 Jan 11 14:04:31.370399 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: clock source: unix Jan 11 14:04:31.370399 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: pcre jit disabled Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: detected number of CPU cores: 4 Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: current working directory: / Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: detected binary path: /usr/bin/uwsgi-core Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: your processes number limit is 47680 Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: your memory page size is 4096 bytes Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: detected max file descriptor number: 2048 Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: lock engine: pthread robust mutexes Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: thunder lock: enabled Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 11 14:04:31.370884 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 11 14:04:31.422174 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: Python main interpreter initialized at 0x5579da9769c0 Jan 11 14:04:31.422174 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: python threads support enabled Jan 11 14:04:31.422174 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: your server socket listen backlog is limited to 100 connections Jan 11 14:04:31.422174 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: your mercy for graceful operations on workers is 90 seconds Jan 11 14:04:31.422545 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: mapped 403077 bytes (393 KB) for 2 cores Jan 11 14:04:31.422627 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: *** Operational MODE: preforking *** Jan 11 14:04:31.422859 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: *** uWSGI is running in multiple interpreter mode *** Jan 11 14:04:31.422859 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: spawned uWSGI master process (pid: 102007) Jan 11 14:04:31.423051 dv-cinder-824131-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 11 14:04:31.425192 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: spawned uWSGI worker 1 (pid: 102008, cores: 1) Jan 11 14:04:31.425192 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: spawned uWSGI worker 2 (pid: 102009, cores: 1) Jan 11 14:04:31.425192 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 11 14:04:33.185459 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 14:04:33.185459 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: from cryptography.utils import int_from_bytes Jan 11 14:04:33.186123 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 14:04:33.186123 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: from cryptography.utils import int_from_bytes Jan 11 14:04:33.253260 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 14:04:33.253260 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: from cryptography.utils import int_from_bytes Jan 11 14:04:33.253846 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 14:04:33.253846 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: from cryptography.utils import int_from_bytes Jan 11 14:04:35.787690 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 14:04:35.788314 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 14:04:35.788419 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 14:04:35.788780 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 14:04:35.789038 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 14:04:35.789428 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.789762 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.790085 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.790406 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.790740 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.791054 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.791378 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.791731 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.792062 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.792322 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.792639 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.792966 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824131-3-iscsi {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.793287 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.793593 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.793905 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.794224 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.794532 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.794856 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.795163 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.795685 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.796126 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.796438 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.796753 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.797100 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.797226 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 14:04:35.797593 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.797696 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 14:04:35.797790 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.797933 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 14:04:35.798045 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.798295 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 14:04:35.798393 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.798560 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 14:04:35.798667 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.798932 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.799074 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.799265 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.799400 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824131-3-iscsi {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.799642 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.799771 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.799970 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.800107 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.800304 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.800436 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.800617 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.800740 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.800943 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.801074 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.801269 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.801398 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.801613 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.801740 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.801873 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.801996 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.802176 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.802284 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.802505 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824131-3-iscsi {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.802597 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.802832 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.802947 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.803140 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.803230 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.803455 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.803588 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.803801 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.803890 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.804109 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.804192 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.804418 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.804579 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.804733 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.804816 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.805039 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.805243 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.805361 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.805556 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.805663 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.805866 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.805957 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.806179 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.806263 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.806506 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.806587 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.806821 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.806914 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.807074 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.807156 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.807327 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.807443 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.807677 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.807784 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.808003 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.808114 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.808316 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.808429 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.808627 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.808837 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824131-3-iscsi {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.808927 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.809156 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.809248 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.809477 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.809559 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.809794 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.809876 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.810118 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.810208 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.810431 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.810520 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.810752 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.810836 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.811069 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.811159 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.811392 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.811475 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.811729 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.811812 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.812052 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.812137 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.812407 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.812489 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.812693 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.812775 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.813005 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.813089 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.813341 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.813423 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.813657 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.813774 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.813968 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.814057 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.814290 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.814374 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.814600 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.814691 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.814911 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.814994 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.815190 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.815292 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.815523 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.815632 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.815856 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.815940 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.816183 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.816266 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.816494 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.816583 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.816746 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.816837 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.816997 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.817086 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.817320 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.817411 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.817647 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.817737 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.817955 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.818036 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.818265 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.818348 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.818575 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.818658 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.818880 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.818970 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.819193 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.819276 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.819516 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.819612 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.819831 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.819915 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.820139 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.820227 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.820449 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.820817 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.821008 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.821105 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.821318 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.821402 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.821626 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.821709 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.821934 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.822029 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.822254 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.822338 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.822574 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.822666 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.822878 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.822973 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.823185 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.823275 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.823509 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.823598 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.823840 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.823942 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.824166 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.824299 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.824476 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.824560 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.824784 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.824880 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.825108 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.825191 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.825416 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.825608 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.825725 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.825818 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.826047 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.826139 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.826359 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.826451 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.826610 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.826695 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.826920 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.827004 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.827230 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.827318 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.827576 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.827665 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.827890 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.827974 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.828200 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.828293 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.828508 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.828592 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.828812 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.828895 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.829120 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.829201 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.829424 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.829511 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.829733 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.829815 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.830036 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.830193 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.830345 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.830427 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.830644 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.830732 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.831471 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.831636 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.831803 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.831914 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.832113 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.832201 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.832421 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.832510 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.832730 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.832820 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.833047 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.833135 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.833359 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.833491 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.833673 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.833763 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.833984 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.834084 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.834310 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.834403 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.834623 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.834706 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.834934 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.835016 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.835261 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.835353 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.835603 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.835746 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.835906 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.835990 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.836229 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.836319 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.836540 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.836626 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.836852 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.836969 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.837169 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.837253 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.837473 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.837557 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.837787 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.837870 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.838109 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.838193 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.838422 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.838506 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.838733 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.838822 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.839048 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.839132 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.839359 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.839441 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.839692 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.839792 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.840003 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.840086 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.840311 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.840393 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.840620 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.840716 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.840925 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.841015 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.841249 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.841331 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.841576 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.841677 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.841888 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.841972 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.842201 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.842284 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.842512 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.842603 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.842831 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.842923 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:04:35.843148 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.843241 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.843466 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.843634 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.843821 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.843914 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.844138 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.844221 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.844452 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.844548 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.844788 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.844879 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.845106 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.845195 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.845422 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.845505 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.845729 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.845855 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.846037 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.846120 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.846344 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.846996 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.847194 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.847279 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.847517 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.847615 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.847848 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.847942 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.848171 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.848254 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.848479 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.848568 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.848813 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.848897 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.849119 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.849201 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.849433 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.849534 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.849747 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.849831 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.850053 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.850142 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.850373 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.850466 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.850689 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.850773 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.850999 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.851088 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.851325 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.851417 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.851663 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.851749 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.851976 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.852061 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.852299 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.852396 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.852610 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.852738 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.852920 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.853001 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.853238 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.853323 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.853549 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.853631 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.853864 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.853954 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.854179 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.854264 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.854502 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.854584 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.854817 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.854900 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.855131 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.855217 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.855458 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.855584 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.855808 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.855938 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.856115 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.856205 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.856422 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.856505 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.856733 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.856824 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.857050 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.857134 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.857356 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.857438 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.857669 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.857765 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.857977 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.858073 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.858284 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.858375 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.858590 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.858683 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.858900 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.858985 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.859209 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.859298 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.859537 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.859642 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.859849 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.859932 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.860156 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.860246 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.860468 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.860559 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.860776 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.860865 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.861091 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.861180 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.861398 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.861483 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.861707 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.861790 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.862033 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.862116 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.862382 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.862465 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.862686 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.862768 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.863005 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.863087 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.863323 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.863414 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.863666 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.863752 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.863987 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.864087 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.864301 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.864391 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.864621 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.864706 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.864935 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.865026 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.865249 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.865331 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.865562 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.865645 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.865876 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.865968 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.866199 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.866289 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.866514 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.866598 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.866833 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.866926 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.867144 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.867234 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.867461 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.867571 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.867796 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.867897 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.868107 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.868191 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.868413 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.868496 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.868727 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.868810 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.869038 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.869123 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.869348 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.869440 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.869656 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.869741 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.869965 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.870048 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.870273 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.870356 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.870601 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.870685 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.870913 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.870996 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.871222 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.871316 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.871547 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.871635 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.871860 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.871943 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.872178 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.872272 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.872493 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.872577 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.872815 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.872899 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.873130 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.873222 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.873458 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.873542 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.873771 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.873860 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.874088 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.874181 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.874395 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.874477 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.874714 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.874796 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.875032 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.875124 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.875349 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.875459 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.875690 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.875784 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.876007 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.876140 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.876320 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.876410 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.876632 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.876715 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.876946 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.877038 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.877262 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.877356 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.877572 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.877672 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.877910 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.877996 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.878224 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.878315 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.878542 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.878631 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.878859 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.878944 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.879173 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.879257 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.879483 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.879635 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.879828 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.879912 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.880143 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.880226 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.880457 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.880553 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.880763 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.880846 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.881078 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.881167 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.881393 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.881485 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.881704 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.881787 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.882025 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.882107 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.882341 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.882501 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.882648 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.882731 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.882954 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.883080 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.883283 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.883381 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.883619 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.883705 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.883928 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.884013 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.884235 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.884320 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.884545 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.884630 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.884874 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.884963 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.885190 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.885272 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.885497 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.885580 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.885818 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.885907 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.886138 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.886272 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.886451 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.886535 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.886764 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.886846 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.887078 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.887167 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.887387 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.887469 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.887721 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.887815 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.888042 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.888124 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.888354 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.888436 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.888667 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.888758 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.888978 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.889061 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.889284 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.889366 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.889593 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.889683 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.889906 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.889988 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.890215 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.890305 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.890525 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.890617 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.890836 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.890918 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.891142 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.891225 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.891453 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.891558 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.891798 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.891893 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.892123 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.892368 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.892461 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.892704 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.892789 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.893026 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.893117 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.893857 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.893962 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.894168 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.894251 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.894478 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.894561 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.894790 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.894885 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.895130 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.895220 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.895442 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.895563 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.895777 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.895860 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.896091 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.896175 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.896398 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.896480 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.896706 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.896791 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.897020 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.897103 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.897329 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.897413 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.897637 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.897721 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.897944 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.898035 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.898257 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.898341 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.898565 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.898649 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.898870 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.898953 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.899183 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.899275 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.899517 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.899604 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.899834 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.899932 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.900139 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.900228 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.900453 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.900545 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.900764 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.900848 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.901077 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.901237 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.901387 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.901488 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.901690 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.901779 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.901996 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.902079 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.902307 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.902560 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.902644 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.902895 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.902978 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.903215 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.903313 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.903573 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.903660 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.903900 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.903987 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.904224 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.904317 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.904530 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.904613 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.904856 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.904939 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.905164 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.905249 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.905473 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.905558 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.905780 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.905863 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.906088 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.906177 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.906397 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.906527 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.906702 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.906785 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.907009 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.907092 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.907317 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.907400 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.907654 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.907752 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.907971 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.908055 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.908281 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.908407 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.908589 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.908682 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.908912 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.909589 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.909742 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.909826 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.910055 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.910148 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.910361 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.910445 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.910668 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.910758 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.910979 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.911062 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.911290 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.911379 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.911621 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.911709 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.911934 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.912034 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.912241 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.912331 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.912552 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.912635 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.912855 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.912937 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.913161 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.913252 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.913467 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.913556 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.913779 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.913870 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.914090 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.914200 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.914395 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.914479 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.914719 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.914811 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.915035 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.915118 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.915340 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.915424 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.915673 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.915772 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.915986 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.916071 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.916292 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.916378 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.916599 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.916697 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.916907 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.916990 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.917226 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.917310 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.917539 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.917623 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.917846 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.917929 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.918157 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.918269 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.918463 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.918548 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.918769 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.918853 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.919074 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.919163 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.919383 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.919472 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.919720 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.919808 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.920028 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.920118 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.920333 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.920424 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.920638 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.920722 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.920948 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.921046 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.921257 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.921412 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.921571 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.921655 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.921876 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.921971 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.922182 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.922289 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.922489 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.922572 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.922794 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.922889 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.923103 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.923186 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.923418 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.923527 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.923759 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.923855 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.924069 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.924199 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.924400 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.924487 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.924738 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.924822 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.925048 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.925138 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.925356 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.925440 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.925660 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.925750 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.925965 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.926048 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.926274 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.926365 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.926585 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.926668 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.926890 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.926973 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.927195 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.927285 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.927545 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.927633 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.927843 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.927926 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.928153 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.928251 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.928461 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.928588 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.928769 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.928853 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.929082 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.929174 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.929389 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.929473 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.929696 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.929780 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.930006 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.930097 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.930314 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.930405 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.930621 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.930711 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.930937 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.931027 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.931247 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.931336 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.931579 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.931664 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.931893 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.931978 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.932201 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.932285 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.932512 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.932594 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.932819 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.932911 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.933133 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.933216 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.933444 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.933534 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.933752 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.933836 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.934079 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.934162 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.934393 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.934476 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.934701 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.934785 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.935012 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.935095 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.935320 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.935412 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.935657 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.935743 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.935966 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.936061 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.936282 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.936439 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.936591 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.936685 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.936900 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.937018 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.937230 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.937325 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.937545 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.937636 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.937861 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.937944 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.938192 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.938284 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.938509 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.938590 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.938817 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.938899 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.939132 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.939224 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.939447 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.939549 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.939789 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.939873 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.940103 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.940189 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.940441 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.940531 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.940755 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.940845 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.941071 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.941155 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.941387 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.941470 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.941691 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.941773 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.941998 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.942082 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.942305 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.942396 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.942610 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.942699 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.942922 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.943005 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.943233 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.943316 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.943561 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.943660 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.943892 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.943983 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.944206 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.944290 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.944515 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.944668 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.944828 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.944982 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.945135 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.945294 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.945450 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.945872 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.946011 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.946197 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.946438 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.946529 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.946757 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.946887 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.947073 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.947157 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.947381 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.947464 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.947723 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.947809 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.948044 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.948133 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.948357 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.948440 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.948673 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.948794 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.948977 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.949066 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.949303 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.949426 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.949630 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.949721 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.949946 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.950029 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.950272 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.950355 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.950592 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.950676 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.950901 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.951005 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.951214 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.951346 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.951634 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.951744 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.951948 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.952054 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.952257 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.952358 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.952563 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.952656 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.952880 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.952969 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.953184 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.953282 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.953490 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.953586 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.953817 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.953906 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.954125 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.954222 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.954441 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.954523 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.954756 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.954913 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.955069 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.955230 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.955377 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.955572 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.955711 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.956414 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.956552 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.956743 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.956863 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.957072 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.957191 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.957381 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.957508 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.957697 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.957830 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.958012 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.958142 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.958339 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.958453 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.958672 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.958765 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.958991 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.959084 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.959308 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.959392 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.959644 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.959742 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.959977 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.960068 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.960306 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.960390 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.960614 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.960698 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.960938 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.961020 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.961273 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.961356 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.961602 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.961693 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.961915 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.962005 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.962252 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.962337 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.962578 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.962663 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.962894 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.962978 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.963202 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.963293 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.963541 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.963630 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.963850 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.963932 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.964156 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.964255 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.964468 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.964596 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.964773 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.964857 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.965078 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.965170 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.965384 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.965468 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.965695 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.965778 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.965999 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.966093 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.966305 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.966388 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.966606 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.966688 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.966925 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.967052 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.967228 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.967311 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.967573 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.967658 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.967888 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.967971 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.968195 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.968285 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.968502 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.968586 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.968808 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.968893 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.969131 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.969213 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.969441 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.969525 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.969749 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.969833 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.970059 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.970142 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.970383 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.970464 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.970699 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.970788 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.971009 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.971091 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.971339 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.971458 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.972245 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.972340 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.972565 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.972653 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.972881 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.972982 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.973200 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.973285 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.973517 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.973601 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.973834 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.973925 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.974150 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.974233 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.974456 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.974539 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.974766 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.974855 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.975080 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.975163 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.975385 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.975470 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.975720 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.975938 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.976023 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.976267 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.976351 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.976584 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.976678 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.976901 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.976985 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.977211 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.977294 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.977525 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.977653 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.977833 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.977918 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.978145 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.978228 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.978459 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.978542 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.978769 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.978852 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.979075 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.979158 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.979385 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.979476 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.979736 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.979820 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.980052 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.980136 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.980383 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.980468 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.980700 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.980783 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.981013 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.981104 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.981334 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.981418 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.981647 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.981736 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.981978 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.982070 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.982300 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.982383 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.982606 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.982690 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.982919 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.983012 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.983233 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.983317 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.983572 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.983707 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.983886 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.983974 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.984207 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.984329 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.984525 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.984610 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.984848 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.984941 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.985161 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.985245 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.985475 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.985559 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.985789 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.985997 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.986088 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.986331 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.986415 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.986653 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.986749 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.986972 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.987056 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.987333 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.987417 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.987678 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.987764 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.988001 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.988121 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.988317 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.988518 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.988641 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.988837 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.988960 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.989172 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.989277 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.989500 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.989600 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.989828 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.989912 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.990147 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.990231 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.990466 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.990571 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.990794 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.990884 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.991101 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.991184 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.991413 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.991527 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.991754 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.991838 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.992069 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.992166 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.992377 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.992485 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.992702 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.992793 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.993014 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.993107 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.993321 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.993406 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.993642 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.993726 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.993955 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.994047 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.994313 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.994486 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.994633 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.994832 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.994951 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.995151 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.995267 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.995479 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.995594 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.995829 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.995929 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.996148 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.996232 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.996457 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.996540 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.996783 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.996875 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.997092 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.997176 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.997401 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.997484 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.997716 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.997808 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.998026 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.998117 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.998333 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.998589 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.998681 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.998913 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.998997 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.999243 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.999326 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.999583 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.999700 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.999899 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:35.999990 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.000207 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.000290 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.000527 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.000618 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.000832 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.000922 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.001140 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.001232 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.001451 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.001543 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.001765 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.001850 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.002068 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.002158 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.002375 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.002506 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.003207 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.003299 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.003538 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.003626 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.003858 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.003944 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.004165 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.004249 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.004479 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.004562 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.004786 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.005013 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.005098 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.005363 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.005447 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.005687 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.005935 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.006044 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.006124 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.006303 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.006388 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.006609 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.006694 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.006917 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.007001 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.007232 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.007326 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.007572 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.007661 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.007886 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.007982 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.008206 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.008345 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.008517 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.008603 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.008827 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.008911 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.009142 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.009233 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.009456 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.009692 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.009777 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.010068 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.010160 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.010384 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.010470 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.010693 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.010778 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.011022 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.011106 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.011331 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.011427 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.011662 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.011761 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.011974 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.012069 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.012289 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.012374 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.012597 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.012682 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.012904 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.012988 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.013213 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.013300 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.013521 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.013606 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.013831 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.013926 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.014136 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.014220 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.014447 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.014531 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.014754 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.014846 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.015065 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.015149 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.015371 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.015454 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.015711 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.015809 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.016022 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.016106 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.016347 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.016439 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.016658 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.016753 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.016968 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.017052 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.017278 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.017372 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.017591 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.017677 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.017904 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.017995 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.018216 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.018353 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.018580 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.018672 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.018913 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.018998 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.019231 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.019316 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.019562 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.019806 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.019981 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.020193 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.020298 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.020519 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.020606 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.020868 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.020969 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.021213 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.021298 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.021526 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.021619 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.021837 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.021922 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.022149 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.022234 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.022471 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.022554 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.022783 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.022866 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.023097 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.023189 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.023411 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.023519 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.023752 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.023837 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.024070 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.024167 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.024385 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.024469 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.024695 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.024781 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.025004 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.025097 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.025316 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.025405 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.025636 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.025720 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.025969 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.026060 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.026286 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.026370 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.026604 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.026686 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.026915 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.027009 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.027234 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.027317 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.027569 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.027700 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.027886 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.027980 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.028200 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.028285 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.028513 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.028596 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.028823 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.028914 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.029156 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.029247 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.029470 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.029599 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.029779 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.029864 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.030089 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.030197 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.030402 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.030499 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.030715 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.030822 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.031027 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.031148 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.031354 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.031448 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.031739 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.031828 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.032052 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.032136 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.032384 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.032469 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.032706 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.032790 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.033029 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.033112 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.033347 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.033437 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.033663 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.033748 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.034522 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.034624 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.034841 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.034926 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.035148 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.035281 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.035458 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.035570 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.035793 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.035879 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.036107 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.036192 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.036427 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.036522 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.036758 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.036842 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.037079 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.037203 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.037406 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.037505 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.037719 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.037804 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.038048 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.038132 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.038362 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.038454 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.038690 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.038774 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.039016 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.039101 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.039329 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.039420 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.039673 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.039760 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.039984 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.040069 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.040231 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 14:04:36.040316 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.040615 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.040931 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.041249 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.041562 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.041878 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.042208 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.042540 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.042853 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.043185 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.043545 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.043854 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.044175 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.044492 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.044829 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.045146 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.045467 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.045783 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.046100 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.046422 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.046743 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.047076 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.047407 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.047837 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.048173 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.048525 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.048843 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.049195 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.049579 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.049909 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.050229 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.050540 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:04:36.050787 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 14:04:36.062871 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_db.sqlalchemy.engines [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:04:36.073212 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG oslo_db.sqlalchemy.engines [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:04:36.129099 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.context [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc1cee38-301e-4e07-ba65-d2dc69c9d82f(cell1) {{(pid=102009) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 14:04:36.133284 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:04:36.134855 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:04:36.135695 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:04:36.137593 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:04:36.138622 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.context [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc1cee38-301e-4e07-ba65-d2dc69c9d82f(cell1) {{(pid=102008) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 14:04:36.142848 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG oslo_concurrency.lockutils [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:04:36.145096 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG oslo_concurrency.lockutils [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:04:36.145917 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG oslo_concurrency.lockutils [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:04:36.147922 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG oslo_concurrency.lockutils [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102008) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:04:36.148926 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_db.sqlalchemy.engines [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:04:36.152100 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_db.sqlalchemy.engines [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:04:36.160024 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG oslo_db.sqlalchemy.engines [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:04:36.163370 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG oslo_db.sqlalchemy.engines [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:04:36.311568 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_db.sqlalchemy.engines [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:04:36.323730 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG oslo_db.sqlalchemy.engines [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:04:36.656360 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: WARNING keystonemiddleware.auth_token [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 14:04:36.657609 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: WARNING keystonemiddleware.auth_token [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 14:04:36.663201 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: WARNING keystonemiddleware.auth_token [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 14:04:36.664277 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: WARNING keystonemiddleware.auth_token [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 14:04:37.001753 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: WARNING keystonemiddleware.auth_token [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 14:04:37.004654 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: WARNING keystonemiddleware.auth_token [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 14:04:37.007367 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: WARNING keystonemiddleware.auth_token [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 14:04:37.009935 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: WARNING keystonemiddleware.auth_token [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 14:04:37.012702 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579da9769c0 pid: 102009 (default app) Jan 11 14:04:37.014742 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:04:37.015005 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579da9769c0 pid: 102008 (default app) Jan 11 14:04:37.015932 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-71a89fba-c4b5-4c50-b00d-cedfa5c89474 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Jan 11 14:04:37.016347 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Tue Jan 11 14:04:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:05.454319 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:05.455520 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Jan 11 14:06:05.455951 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:05.879430 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-6ccbb8ad-8af7-443c-86e2-8aa47a9ec978 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:05.908640 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-6ccbb8ad-8af7-443c-86e2-8aa47a9ec978 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.446587 Jan 11 14:06:05.910003 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Jan 11 14:06:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:06:08.358869 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:08.360039 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-4a7df7cf-eebe-4193-9782-9f8d6523c6d0 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jan 11 14:06:08.360441 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 2/4] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:08.420969 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-6d59bd9c-aeea-4216-ac33-b5ef8b6462cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "ram": 256}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:08.439538 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:06:08.439538 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: warnings.warn(msg) Jan 11 14:06:08.469670 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-6d59bd9c-aeea-4216-ac33-b5ef8b6462cf admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102312 Jan 11 14:06:08.470438 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 3/5] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:06:08.686732 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-197e3939-feef-41dc-9246-48cc099d1ee5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:08.689490 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:06:08.689490 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: warnings.warn(msg) Jan 11 14:06:08.736325 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-197e3939-feef-41dc-9246-48cc099d1ee5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257895 Jan 11 14:06:08.736902 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 3/6] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Jan 11 14:06:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:06:11.204582 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-6d59bd9c-aeea-4216-ac33-b5ef8b6462cf admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:11.205595 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-6d59bd9c-aeea-4216-ac33-b5ef8b6462cf admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Jan 11 14:06:11.206460 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 4/7] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:11.321674 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-0c3ffb05-5628-4a12-8c22-f72b67d68954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "vcpus": 1, "id": "d1", "disk": 5, "swap": 0}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:11.340154 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:06:11.340154 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: warnings.warn(msg) Jan 11 14:06:11.360295 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-0c3ffb05-5628-4a12-8c22-f72b67d68954 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147781 Jan 11 14:06:11.367600 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 4/8] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:06:11.372797 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-acaac5a4-0902-4e03-b697-95834b6ec7d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:11.374586 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:06:11.374586 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: warnings.warn(msg) Jan 11 14:06:11.407955 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-acaac5a4-0902-4e03-b697-95834b6ec7d4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038709 Jan 11 14:06:11.408920 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 5/9] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Jan 11 14:06:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:06:13.880203 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-0c3ffb05-5628-4a12-8c22-f72b67d68954 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:13.881223 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-0c3ffb05-5628-4a12-8c22-f72b67d68954 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jan 11 14:06:13.881803 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:13.939368 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-7bef8c73-0ef2-42ad-ad4b-5eabf20616b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:13.962932 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-7bef8c73-0ef2-42ad-ad4b-5eabf20616b0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075148 Jan 11 14:06:13.963898 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 6/11] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:06:13.976389 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-965b2fe5-9381-4d87-a4e1-7b853b7405ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:13.999569 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-965b2fe5-9381-4d87-a4e1-7b853b7405ca admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027054 Jan 11 14:06:14.000367 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 6/12] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Jan 11 14:06:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:06:16.474970 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-7bef8c73-0ef2-42ad-ad4b-5eabf20616b0 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:16.476119 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-7bef8c73-0ef2-42ad-ad4b-5eabf20616b0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Jan 11 14:06:16.476533 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:16.531814 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-b3fa08a3-36a9-44e1-abd1-72052d4f817b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:16.549227 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-b3fa08a3-36a9-44e1-abd1-72052d4f817b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067147 Jan 11 14:06:16.549772 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 7/14] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:06:16.561316 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-4726ff0f-f157-437f-9aff-92ef6d611bc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:16.590596 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-4726ff0f-f157-437f-9aff-92ef6d611bc3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032900 Jan 11 14:06:16.591168 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 8/15] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Jan 11 14:06:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:06:19.060439 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-b3fa08a3-36a9-44e1-abd1-72052d4f817b admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:19.061452 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-b3fa08a3-36a9-44e1-abd1-72052d4f817b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 11 14:06:19.061894 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 8/16] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:19.121173 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-8ad95292-698c-4e60-8e0e-c585442d0c4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:19.147554 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-8ad95292-698c-4e60-8e0e-c585442d0c4e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072352 Jan 11 14:06:19.147554 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 9/17] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:06:19.156952 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-b80cc39a-4054-485a-a85c-69766fb25093 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:19.182246 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-b80cc39a-4054-485a-a85c-69766fb25093 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029047 Jan 11 14:06:19.188392 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 9/18] 10.222.0.49 () {64 vars in 1335 bytes} [Tue Jan 11 14:06:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:06:21.867847 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-8ad95292-698c-4e60-8e0e-c585442d0c4e admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:21.868940 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-8ad95292-698c-4e60-8e0e-c585442d0c4e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Jan 11 14:06:21.869355 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 10/19] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:06:21.928498 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-82a53352-0b17-4232-a7c1-c6229489906a admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:21.958479 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-82a53352-0b17-4232-a7c1-c6229489906a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082505 Jan 11 14:06:21.959153 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 10/20] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Jan 11 14:06:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:06:24.424296 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-8ad95292-698c-4e60-8e0e-c585442d0c4e admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:24.425322 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-8ad95292-698c-4e60-8e0e-c585442d0c4e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jan 11 14:06:24.425733 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 11/21] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:24.484121 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-008e610b-1f35-4738-b515-a01a6955d48e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "1", "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:24.502002 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-008e610b-1f35-4738-b515-a01a6955d48e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070388 Jan 11 14:06:24.502547 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 11/22] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:06:24.514286 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-8dcc422b-f501-40b9-a753-c8c6b446251d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:24.537057 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-8dcc422b-f501-40b9-a753-c8c6b446251d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026417 Jan 11 14:06:24.537642 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 12/23] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Jan 11 14:06:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:06:27.391847 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-008e610b-1f35-4738-b515-a01a6955d48e admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:27.393192 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-008e610b-1f35-4738-b515-a01a6955d48e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002550 Jan 11 14:06:27.393759 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:27.460839 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-8b96d49f-d100-45bd-a43e-a8ced77fb38b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:27.479392 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-8b96d49f-d100-45bd-a43e-a8ced77fb38b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078366 Jan 11 14:06:27.480134 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 13/25] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:06:27.493581 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-7cae711a-97d5-446b-b8b5-1c36c84ff676 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:27.516067 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-7cae711a-97d5-446b-b8b5-1c36c84ff676 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025580 Jan 11 14:06:27.516619 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Jan 11 14:06:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:06:30.026884 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-8b96d49f-d100-45bd-a43e-a8ced77fb38b admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:30.027929 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-8b96d49f-d100-45bd-a43e-a8ced77fb38b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 11 14:06:30.028491 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:30.087381 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-e2a400f4-7162-4a75-b6ba-3f43043f3cbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "vcpus": 2, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:30.106291 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-e2a400f4-7162-4a75-b6ba-3f43043f3cbc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071653 Jan 11 14:06:30.106837 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 14/28] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:06:30.118876 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-ae290b6c-cfbb-4941-8da5-bc55e278f8f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:30.140591 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-ae290b6c-cfbb-4941-8da5-bc55e278f8f0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025263 Jan 11 14:06:30.141151 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 15/29] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Jan 11 14:06:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:06:32.627812 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-e2a400f4-7162-4a75-b6ba-3f43043f3cbc admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:32.629433 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-e2a400f4-7162-4a75-b6ba-3f43043f3cbc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Jan 11 14:06:32.630364 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:32.719811 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-f1f54e22-2e9a-4710-b68f-f141ca03dde0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "ram": 8192, "name": "m1.large"}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:32.741507 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-f1f54e22-2e9a-4710-b68f-f141ca03dde0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.105979 Jan 11 14:06:32.742065 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 16/31] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:06:32.754156 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-fa232b15-f37d-44e9-96c4-69a713837822 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:32.778885 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-fa232b15-f37d-44e9-96c4-69a713837822 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028639 Jan 11 14:06:32.779460 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 16/32] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Jan 11 14:06:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:06:35.335166 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-f1f54e22-2e9a-4710-b68f-f141ca03dde0 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:35.336628 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-f1f54e22-2e9a-4710-b68f-f141ca03dde0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Jan 11 14:06:35.337031 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:35.401465 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-1488fb38-bd86-48a4-83e8-f53ee156d151 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "vcpus": 8, "ram": 16384}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:35.427957 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-1488fb38-bd86-48a4-83e8-f53ee156d151 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077749 Jan 11 14:06:35.427957 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 17/34] 10.222.0.49 () {64 vars in 1282 bytes} [Tue Jan 11 14:06:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:06:35.432909 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-1daba05f-6460-4a57-9b21-e425029210b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:06:35.458114 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-1daba05f-6460-4a57-9b21-e425029210b6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028802 Jan 11 14:06:35.468762 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 18/35] 10.222.0.49 () {64 vars in 1332 bytes} [Tue Jan 11 14:06:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:06:57.025314 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-1488fb38-bd86-48a4-83e8-f53ee156d151 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:57.026311 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-1488fb38-bd86-48a4-83e8-f53ee156d151 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jan 11 14:06:57.026700 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 18/36] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:57.082720 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-43d5d062-3c23-4fc4-a7b9-c05ac5424b4a admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:57.099109 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-43d5d062-3c23-4fc4-a7b9-c05ac5424b4a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066611 Jan 11 14:06:57.099660 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Jan 11 14:06:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:06:58.739933 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-1488fb38-bd86-48a4-83e8-f53ee156d151 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:58.740969 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-1488fb38-bd86-48a4-83e8-f53ee156d151 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jan 11 14:06:58.741360 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:06:58.940058 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-dd35ff73-0577-4185-b4de-f51284c756d7 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:58.945437 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.wsgi [None req-dd35ff73-0577-4185-b4de-f51284c756d7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 11 14:06:58.945999 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-dd35ff73-0577-4185-b4de-f51284c756d7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:06:58.947046 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-dd35ff73-0577-4185-b4de-f51284c756d7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056828 Jan 11 14:06:58.947572 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Jan 11 14:06:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 14:06:58.956647 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-bd0bc8d1-afaf-4959-aef2-ef22a25113a1 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:58.976477 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-bd0bc8d1-afaf-4959-aef2-ef22a25113a1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023440 Jan 11 14:06:58.977006 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Jan 11 14:06:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:06:58.986606 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-4e1f199a-45df-4697-bc6f-76dd6c7032f8 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:59.007280 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-4e1f199a-45df-4697-bc6f-76dd6c7032f8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024575 Jan 11 14:06:59.007845 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Jan 11 14:06:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:06:59.016665 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-a6e852ff-42b9-4081-bbe2-ab3c083db975 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:06:59.022089 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.wsgi [None req-a6e852ff-42b9-4081-bbe2-ab3c083db975 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 11 14:06:59.022661 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-a6e852ff-42b9-4081-bbe2-ab3c083db975 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:06:59.023449 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-a6e852ff-42b9-4081-bbe2-ab3c083db975 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010266 Jan 11 14:06:59.023957 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Jan 11 14:06:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 11 14:07:00.554216 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-4e1f199a-45df-4697-bc6f-76dd6c7032f8 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:00.555225 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-4e1f199a-45df-4697-bc6f-76dd6c7032f8 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jan 11 14:07:00.555666 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:07:00.748347 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-4520ab84-31d4-4ef6-a45f-9c14cd9df6c1 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:00.753564 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.wsgi [None req-4520ab84-31d4-4ef6-a45f-9c14cd9df6c1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 11 14:07:00.754124 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-4520ab84-31d4-4ef6-a45f-9c14cd9df6c1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:07:00.754910 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-4520ab84-31d4-4ef6-a45f-9c14cd9df6c1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059033 Jan 11 14:07:00.755411 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Jan 11 14:07:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 14:07:00.764339 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-e747ef3c-942e-40fb-a3fb-e138fa5f838a admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:00.777429 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-e747ef3c-942e-40fb-a3fb-e138fa5f838a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016583 Jan 11 14:07:00.777948 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Jan 11 14:07:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:07:00.787820 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-77e75051-e06b-4a82-8aec-809c49234a6f admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:00.801327 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-77e75051-e06b-4a82-8aec-809c49234a6f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016979 Jan 11 14:07:00.801800 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Jan 11 14:07:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:07:00.810993 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-5c2ca3d2-054d-4eab-b4ee-4526f36a15d5 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:00.816709 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.wsgi [None req-5c2ca3d2-054d-4eab-b4ee-4526f36a15d5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 11 14:07:00.817267 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-5c2ca3d2-054d-4eab-b4ee-4526f36a15d5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:07:00.818043 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-5c2ca3d2-054d-4eab-b4ee-4526f36a15d5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010545 Jan 11 14:07:00.818531 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 24/47] 10.222.0.49 () {60 vars in 1190 bytes} [Tue Jan 11 14:07:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 14:07:02.336621 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-77e75051-e06b-4a82-8aec-809c49234a6f admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:02.337624 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-77e75051-e06b-4a82-8aec-809c49234a6f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jan 11 14:07:02.338012 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 24/48] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:07:02.526809 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-8524cda6-873a-4432-b218-03122c40973d admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:02.532450 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.wsgi [None req-8524cda6-873a-4432-b218-03122c40973d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 11 14:07:02.533013 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-8524cda6-873a-4432-b218-03122c40973d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:07:02.533799 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-8524cda6-873a-4432-b218-03122c40973d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057027 Jan 11 14:07:02.534297 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Jan 11 14:07:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 14:07:02.543193 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-49d25e2b-0819-4f52-b25d-13acbbde3646 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:02.556911 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-49d25e2b-0819-4f52-b25d-13acbbde3646 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017253 Jan 11 14:07:02.557420 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Jan 11 14:07:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:07:02.567673 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:02.580724 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017445 Jan 11 14:07:02.581249 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 26/51] 10.222.0.49 () {60 vars in 1210 bytes} [Tue Jan 11 14:07:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:07:02.590051 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-1789abc3-3eaf-4698-87d7-f47c4894c6b6 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:02.595583 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.wsgi [None req-1789abc3-3eaf-4698-87d7-f47c4894c6b6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 11 14:07:02.596143 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-1789abc3-3eaf-4698-87d7-f47c4894c6b6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102008) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:07:02.596916 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-1789abc3-3eaf-4698-87d7-f47c4894c6b6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010328 Jan 11 14:07:02.597392 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 26/52] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Jan 11 14:07:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 14:07:04.116508 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:04.117512 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jan 11 14:07:04.117906 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:07:04.306096 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-99a60400-7eaf-48d0-8693-61a38a760ae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:07:04.324155 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-99a60400-7eaf-48d0-8693-61a38a760ae8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068367 Jan 11 14:07:04.324704 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Jan 11 14:07:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:07:05.841452 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:05.842626 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jan 11 14:07:05.843308 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:07:06.033373 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-5c7a8437-d94d-4576-ac8c-47e35cb019a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:07:06.050002 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-5c7a8437-d94d-4576-ac8c-47e35cb019a7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066709 Jan 11 14:07:06.050516 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 28/56] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Jan 11 14:07:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:07:07.561125 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:07.562151 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jan 11 14:07:07.562546 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:07:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:07:07.750929 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-dad613ab-a7dc-431e-8d6d-8d0f6b506927 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:07:07.768369 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-dad613ab-a7dc-431e-8d6d-8d0f6b506927 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067731 Jan 11 14:07:07.768963 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 29/58] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Jan 11 14:07:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:07:09.296736 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:09.297785 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Jan 11 14:07:09.298178 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 30/59] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:07:09.495332 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-eda3c526-3809-464c-b728-aa9a7f0d7c14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:07:09.512248 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-eda3c526-3809-464c-b728-aa9a7f0d7c14 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067311 Jan 11 14:07:09.512772 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 30/60] 10.222.0.49 () {64 vars in 1235 bytes} [Tue Jan 11 14:07:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:07:11.025450 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:11.026439 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jan 11 14:07:11.026834 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 31/61] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:07:11.215469 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-c88e53c5-aa0e-453e-9ea8-c252707f610f admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:11.234906 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-c88e53c5-aa0e-453e-9ea8-c252707f610f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069433 Jan 11 14:07:11.235433 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 31/62] 10.222.0.49 () {60 vars in 1202 bytes} [Tue Jan 11 14:07:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:07:59.276631 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:59.277634 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-0c40d447-bc83-4452-bace-bc10647a9862 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jan 11 14:07:59.278032 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 930 bytes} [Tue Jan 11 14:07:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:07:59.334527 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-5757302e-8769-4eaf-b1f4-661ef127529b admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:59.353002 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-5757302e-8769-4eaf-b1f4-661ef127529b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069191 Jan 11 14:07:59.353525 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 32/64] 10.222.0.49 () {60 vars in 1291 bytes} [Tue Jan 11 14:07:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:07:59.374970 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-cb37976c-6099-4214-b16d-2836cdbb690b admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:59.382462 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-cb37976c-6099-4214-b16d-2836cdbb690b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011491 Jan 11 14:07:59.382973 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1282 bytes} [Tue Jan 11 14:07:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:07:59.394031 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-a04d6231-5367-4ea8-ab0a-77b1c5187835 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:59.401366 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-a04d6231-5367-4ea8-ab0a-77b1c5187835 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010698 Jan 11 14:07:59.401861 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 33/66] 10.222.0.49 () {60 vars in 1285 bytes} [Tue Jan 11 14:07:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:07:59.412250 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-2f6daa82-6090-497d-9106-7dd7a6df257c admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:59.419522 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-2f6daa82-6090-497d-9106-7dd7a6df257c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010544 Jan 11 14:07:59.420022 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 34/67] 10.222.0.49 () {60 vars in 1285 bytes} [Tue Jan 11 14:07:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:07:59.430411 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:07:59.438438 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011341 Jan 11 14:07:59.438940 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 34/68] 10.222.0.49 () {60 vars in 1282 bytes} [Tue Jan 11 14:07:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:09:29.509078 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-7e283ca3-19a2-409f-b9ad-c00d47683e93 tempest-verify_tempest_config-1652606032 tempest-verify_tempest_config-1652606032-project] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:09:29.511062 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-7e283ca3-19a2-409f-b9ad-c00d47683e93 tempest-verify_tempest_config-1652606032 tempest-verify_tempest_config-1652606032-project] 10.222.0.49 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.102482 Jan 11 14:09:29.511610 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 35/69] 10.222.0.49 () {58 vars in 1133 bytes} [Tue Jan 11 14:09:29 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:10:59.002037 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:10:59.003037 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 11 14:10:59.003430 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 35/70] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:10:59.253765 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-c4accc9a-5502-40bb-83c2-0eb728eb4a67 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:10:59.255031 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:10:59.255031 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: warnings.warn(msg) Jan 11 14:10:59.256567 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-c4accc9a-5502-40bb-83c2-0eb728eb4a67 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:10:59.257005 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-c4accc9a-5502-40bb-83c2-0eb728eb4a67 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:10:59.257788 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-c4accc9a-5502-40bb-83c2-0eb728eb4a67 admin admin] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:10:59.258210 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-c4accc9a-5502-40bb-83c2-0eb728eb4a67 admin admin] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:10:59.291621 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-c4accc9a-5502-40bb-83c2-0eb728eb4a67 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148075 Jan 11 14:10:59.292175 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 36/71] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Jan 11 14:10:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:11:00.857242 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:11:00.858240 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jan 11 14:11:00.858631 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 36/72] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:11:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:11:01.055016 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-c9114098-9fac-4c41-98d3-395245066013 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:11:01.056214 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:11:01.056214 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: warnings.warn(msg) Jan 11 14:11:01.057729 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-c9114098-9fac-4c41-98d3-395245066013 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:11:01.058172 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-c9114098-9fac-4c41-98d3-395245066013 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:11:01.059520 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-c9114098-9fac-4c41-98d3-395245066013 admin admin] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:11:01.059955 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-c9114098-9fac-4c41-98d3-395245066013 admin admin] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:11:01.079632 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-c9114098-9fac-4c41-98d3-395245066013 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074321 Jan 11 14:11:01.080220 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 37/73] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Jan 11 14:11:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:11:13.026216 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:11:13.027222 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jan 11 14:11:13.027653 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 37/74] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:11:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:11:13.219109 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-083761a2-6a23-436d-be9d-7d274d8fdb90 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:11:13.220337 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:11:13.220337 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: warnings.warn(msg) Jan 11 14:11:13.221843 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-083761a2-6a23-436d-be9d-7d274d8fdb90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:11:13.222288 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-083761a2-6a23-436d-be9d-7d274d8fdb90 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:11:13.223090 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-083761a2-6a23-436d-be9d-7d274d8fdb90 admin admin] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:11:13.223539 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-083761a2-6a23-436d-be9d-7d274d8fdb90 admin admin] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:11:13.248656 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-083761a2-6a23-436d-be9d-7d274d8fdb90 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080015 Jan 11 14:11:13.249135 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 38/75] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Jan 11 14:11:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:11:14.800598 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: DEBUG nova.api.openstack.wsgi [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] Calling method '>' {{(pid=102008) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:11:14.801591 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: INFO nova.api.openstack.requestlog [None req-c2f2a1cf-fe03-4be8-8261-3f7b7f5353e2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jan 11 14:11:14.801991 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: [pid: 102008|app: 0|req: 38/76] 10.222.0.49 () {56 vars in 1074 bytes} [Tue Jan 11 14:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:11:14.991606 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG nova.api.openstack.wsgi [None req-64738cda-2e21-4951-8cc2-2efa45adc3d1 admin admin] Calling method '>' {{(pid=102009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:11:14.992766 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:11:14.992766 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: warnings.warn(msg) Jan 11 14:11:14.994314 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-64738cda-2e21-4951-8cc2-2efa45adc3d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:11:14.994757 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-64738cda-2e21-4951-8cc2-2efa45adc3d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:11:14.995679 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-64738cda-2e21-4951-8cc2-2efa45adc3d1 admin admin] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:11:14.996117 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: DEBUG oslo_concurrency.lockutils [None req-64738cda-2e21-4951-8cc2-2efa45adc3d1 admin admin] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:11:15.017458 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: INFO nova.api.openstack.requestlog [None req-64738cda-2e21-4951-8cc2-2efa45adc3d1 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076065 Jan 11 14:11:15.017987 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: [pid: 102009|app: 0|req: 39/77] 10.222.0.49 () {60 vars in 1193 bytes} [Tue Jan 11 14:11:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:12:14.488220 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: Tue Jan 11 14:12:14 2022 - graceful shutdown triggered... Jan 11 14:12:14.487986 dv-cinder-824131-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 11 14:12:14.489208 dv-cinder-824131-3-iscsi devstack@n-api.service[102008]: Gracefully killing worker 1 (pid: 102008)... Jan 11 14:12:14.489594 dv-cinder-824131-3-iscsi devstack@n-api.service[102009]: Gracefully killing worker 2 (pid: 102009)... Jan 11 14:12:15.488997 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: worker 1 buried after 1 seconds Jan 11 14:12:15.489539 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: worker 2 buried after 1 seconds Jan 11 14:12:15.489539 dv-cinder-824131-3-iscsi devstack@n-api.service[102007]: goodbye to uWSGI. Jan 11 14:12:15.490505 dv-cinder-824131-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 11 14:12:15.491056 dv-cinder-824131-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 11 14:12:15.493791 dv-cinder-824131-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 11 14:12:15.507308 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 11 14:12:15 2022] *** Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: nodename: dv-cinder-824131-3-iscsi Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: machine: x86_64 Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: clock source: unix Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: pcre jit disabled Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: detected number of CPU cores: 4 Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: current working directory: / Jan 11 14:12:15.509190 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: detected binary path: /usr/bin/uwsgi-core Jan 11 14:12:15.509944 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: your processes number limit is 47680 Jan 11 14:12:15.509944 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: your memory page size is 4096 bytes Jan 11 14:12:15.509944 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: detected max file descriptor number: 2048 Jan 11 14:12:15.509944 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: lock engine: pthread robust mutexes Jan 11 14:12:15.509944 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: thunder lock: enabled Jan 11 14:12:15.509944 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 11 14:12:15.509944 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 11 14:12:15.561354 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: Python main interpreter initialized at 0x55e75a8629c0 Jan 11 14:12:15.561354 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: python threads support enabled Jan 11 14:12:15.561354 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: your server socket listen backlog is limited to 100 connections Jan 11 14:12:15.561354 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: your mercy for graceful operations on workers is 90 seconds Jan 11 14:12:15.561808 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: mapped 403077 bytes (393 KB) for 2 cores Jan 11 14:12:15.561808 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: *** Operational MODE: preforking *** Jan 11 14:12:15.562051 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: *** uWSGI is running in multiple interpreter mode *** Jan 11 14:12:15.562051 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: spawned uWSGI master process (pid: 116458) Jan 11 14:12:15.562798 dv-cinder-824131-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 11 14:12:15.564535 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: spawned uWSGI worker 1 (pid: 116474, cores: 1) Jan 11 14:12:15.564535 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: spawned uWSGI worker 2 (pid: 116475, cores: 1) Jan 11 14:12:15.564535 dv-cinder-824131-3-iscsi devstack@n-api.service[116458]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 11 14:12:17.519034 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 14:12:17.519034 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: from cryptography.utils import int_from_bytes Jan 11 14:12:17.519841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 14:12:17.519841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: from cryptography.utils import int_from_bytes Jan 11 14:12:17.523638 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 14:12:17.523638 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: from cryptography.utils import int_from_bytes Jan 11 14:12:17.524146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 14:12:17.524146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: from cryptography.utils import int_from_bytes Jan 11 14:12:19.941918 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 14:12:19.942515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 14:12:19.945414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 14:12:19.945414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 14:12:19.945414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 14:12:19.945414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.945414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.945414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.945414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.945414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.946011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.946011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.946011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.946413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.946521 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.946832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.947167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824131-3-iscsi {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.947778 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.948099 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.948420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.948747 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.949059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.949391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.949707 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.950218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.951599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.951599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.951599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.951992 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.952280 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.952626 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.953549 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.953871 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.954209 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.954522 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.954937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824131-3-iscsi {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.955266 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.955620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.955964 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.956378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.956773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.957113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.957433 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.957772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.958093 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.958430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.958763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.959095 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.959429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.959765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.960085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.960405 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.960736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.961051 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.961367 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.961625 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.961944 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.962095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 14:12:19.962569 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 14:12:19.962723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.962723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.963007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 14:12:19.963181 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.963339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 14:12:19.963535 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.963767 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 14:12:19.963928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.963928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.964231 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.964382 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.964536 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.964687 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.964839 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.965010 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.965166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.965318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.965463 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.965607 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.965764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.965909 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.966054 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.966211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.966356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.966508 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.966662 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.966813 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.966968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.967141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.967297 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.967441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.967679 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824131-3-iscsi {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.967833 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.967986 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.968158 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.968312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.968502 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.968670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.968835 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.968988 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.969174 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.969327 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.969499 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.969655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.969811 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.969957 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.970111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.970111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.970989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.971154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.971299 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.971464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.971665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.971821 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.971980 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.972166 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.972312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.972455 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.972598 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.972760 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.972914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.973101 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.973290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.973447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.973603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.973760 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.973915 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.974067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.974218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.974362 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.974512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824131-3-iscsi {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.974666 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.974845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.975000 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.975152 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.975296 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.975464 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.975632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.975632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.975918 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.976073 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.976226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.976378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.976531 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.976674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.976817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.976975 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.977138 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.977283 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.977443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.977595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.977739 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.977889 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.978200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.978352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.978497 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.978641 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.978794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.978939 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.979095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.979246 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.979390 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.979604 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.979756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.979911 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.980056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.980208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.980388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.981155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.981864 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.981985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982064 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982222 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982302 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982380 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982519 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982809 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.982984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983074 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983252 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983423 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983648 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.983944 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.984035 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.984130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.984219 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.984301 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.984391 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.984606 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.984777 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.984939 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.985087 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.985241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.985397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.985543 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.985686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.985892 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.986051 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.986206 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.986361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.986508 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.986676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.986821 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.986965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.987108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.987301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.987461 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.987669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.987833 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.987981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.988273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.988425 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.988580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.988751 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.988897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.989144 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.989349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.989467 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.989579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.989706 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.989831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.989944 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.990053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.990173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.990298 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.990595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.991851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.992027 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.992195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.992479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.992689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.992877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.992877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.993152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.993295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.993469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.993763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.993962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.994123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.994268 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.994410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.994553 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.994741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.994898 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.995085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.995232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.995376 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.995567 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.995767 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.995919 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.996072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.996233 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.996388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.996540 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.996692 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.996878 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.997070 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.997220 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.997373 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.997517 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.997660 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.997837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.997994 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.998146 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.998314 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.998460 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.998611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.998767 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.998951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.999135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:19.999302 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:19.999448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.000198 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.000345 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.000499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.000649 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.000809 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.001008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.001671 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.002031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.002186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.002344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.002497 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.002649 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.002804 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.002949 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.003093 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.003237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.003387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.003560 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.003769 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.003927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.004073 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.004259 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.004413 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.004564 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.004724 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.004878 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.005058 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.005207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.005353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.005507 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.005671 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.005824 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.005968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.006122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.006281 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.006435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.006579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.006732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.006878 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.007029 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.007174 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.007326 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.007471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.007701 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.007887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.008050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.008353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.008507 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.008667 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.008848 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.008997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.009173 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.009330 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.009476 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.009634 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.009780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.009970 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.010118 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.010270 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.010414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.010569 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 14:12:20.010723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.010877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.011054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.011054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.011879 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.012295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.012492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.012653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.012811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.012956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.013141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.013332 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.013487 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.013631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.013776 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.013927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.014085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.014237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.014381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.014533 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.014697 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.014850 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.015004 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.015220 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.015950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.016112 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.016259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.016418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.016597 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.016754 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.016900 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.017056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.017246 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.017418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.017573 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.017717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.017880 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.018026 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.018178 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.018350 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.018575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.018731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.018884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.019036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.019036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.019372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.019590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.019752 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.019906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.020091 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.020254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.020400 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.020559 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.020704 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.020848 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.020999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.021154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.021306 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.021571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.022046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.022400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.022562 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.022722 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.022868 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.023012 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.023164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.023318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.023532 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.023704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.023850 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.024002 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.024167 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.024312 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.024469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.024652 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.024800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.024951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.025095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.025239 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.025449 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.025599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.025743 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.025895 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.026046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.026202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.026361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.026507 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.026650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.026794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.026937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.027079 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.027232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.027378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.027596 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.027763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.027919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.028106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.028106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.028407 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.028569 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.028790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.028790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.029092 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.029238 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.029390 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.029542 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.029694 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.029847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.030005 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.030161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.030312 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.030464 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.030616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.030760 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.030916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.031061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.031212 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.031364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.031552 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.031552 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.032311 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.032678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.032845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.032998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.033143 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.033305 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.033484 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.033648 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.033794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.033938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.034081 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.034239 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.034400 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.034545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.034690 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.034853 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.034998 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.035153 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.035298 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.035450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.035702 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.035874 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.036652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.036813 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.036965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.037125 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.037289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.037447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.037598 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.037992 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.038167 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.038336 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.038496 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.038655 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.038827 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.039118 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.039287 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.039456 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.039635 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.039811 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.039972 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.040124 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.040284 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.040444 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.040603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.040801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.040959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.041111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.041275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.041427 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.041611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.041856 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.042403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.042591 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.043037 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.043216 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.043371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.043540 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.043742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.043900 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.044062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.044259 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.044424 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.044586 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.044750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.044983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.045151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.045303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.045463 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.045614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.045764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.045924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.046084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.046244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.046244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.047046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.047206 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.047387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.047672 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.047832 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.047983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.048133 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.048292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.048453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.048606 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.048764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.048952 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.049204 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.049753 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.049933 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.050110 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.050272 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.050433 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.050585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.050906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.051072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.051309 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.051484 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.051733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.052008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.052603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.052785 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.053137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.053309 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.053460 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.053612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.053777 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.053938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.054236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.054403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.054564 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.054795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.054962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.055115 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.055266 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.055415 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.055824 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.055997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.056150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.056301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.056452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.056452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.056895 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.057064 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.057217 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.057217 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.057518 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.057673 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.057843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.058008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.058160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.058318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.058469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.058619 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.058769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.058935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.059095 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.059339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.059516 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.059684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.059851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.060056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.060318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.060477 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.060637 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.060789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.060951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.061103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.061262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.061422 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.061574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.061732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.061893 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.062962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.063651 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.063763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.063850 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.063930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064086 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064371 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064527 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064597 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.064979 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065139 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065217 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065294 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065370 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065439 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065662 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065740 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065810 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065885 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.065974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066052 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066122 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066198 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066269 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066499 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066651 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066731 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.066953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067314 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067561 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067635 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067865 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.067943 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068020 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068238 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068305 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068458 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068626 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068705 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068781 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068850 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.068925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069078 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069220 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069356 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069433 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069509 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069509 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069785 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069863 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.069933 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070341 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070413 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070633 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.070938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071349 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071508 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071596 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071745 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071819 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071895 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.071978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072193 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072261 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072327 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072327 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072724 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072802 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.072939 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073006 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073087 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073158 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073233 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073309 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073616 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073683 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.073899 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.074012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.074190 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.074316 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.074499 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.074628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.074809 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.074916 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.075664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.075865 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.076022 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.076181 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.076331 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.076490 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.076643 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.076844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.077000 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.077160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.077310 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.077459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.077640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.077812 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.077962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.078127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.078277 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.078426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.078583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.078742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.078905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.079056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.079204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.079353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.079522 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.079522 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.079852 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.080011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.080161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.080316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.080474 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.080624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.080787 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.080946 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.081103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.081268 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.081419 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.081704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.081803 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.081883 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.081966 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.082981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.083140 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.083313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.083458 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.083670 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.083822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.084006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.084145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.084320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.084467 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.084640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.084791 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.084960 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.085111 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.085276 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.085436 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.085593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.085758 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.085911 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.086089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.086227 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.086414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.086545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.086733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.086868 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.087050 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.087186 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.087373 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.087528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.087722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.087842 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.088043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.088170 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.088426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.088565 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.088668 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.088754 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.088999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.089097 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.089318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.089417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.089642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.089784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.089962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.090062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.090278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.090385 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.090599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.090694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.090912 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.091006 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.091249 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.091353 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.091604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.091714 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.091927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.092031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.092246 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.092351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.092611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.092710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.092883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.092979 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.093221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.093321 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.093548 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.093643 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.093867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.094029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.094203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.094354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.094516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.094649 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.094840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.094934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.095159 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.095253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.095478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.095646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.095820 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.095923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.096136 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.096226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.096450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.096547 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.096769 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.096869 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.097077 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.097164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.097388 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.097486 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.097706 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.097803 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.098015 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.098111 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.098344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.098434 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.098661 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.098759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.098983 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.099147 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.099301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.099392 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.099686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.099794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.100011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.100111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.100384 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.100482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.100707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.100798 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.101036 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.101126 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.101366 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.101462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.101680 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.101779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.102000 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.102097 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.102318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.102408 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.102634 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.102731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.102962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.103060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.103280 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.103368 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.103630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.103723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.103947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.104049 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.104263 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.104365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.104597 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.104716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.104917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.105011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.105239 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.105340 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.105577 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.105667 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.105917 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.106015 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.106258 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.106358 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.106579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.106668 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.106904 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.106995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.107224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.107321 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.107559 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.107667 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.107881 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.107978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.108195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.108286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.108509 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.108600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.109335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.109434 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.109664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.109753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.109985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.110074 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.110304 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.110464 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.110621 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.110719 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.110934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.111024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.111258 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.111376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.111621 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.111736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.111945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.112069 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.112266 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.112374 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.112583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.112689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.112909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.113008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.113228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.113373 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.113566 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.113659 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.113871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.114009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.114226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.114359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.114539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.114630 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.114854 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.114943 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.115166 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.115307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.115531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.115628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.115849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.115951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.116178 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.116269 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.116516 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.116615 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.116847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.116943 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.117169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.117286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.117512 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.117611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.117846 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.118007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.118168 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.118257 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.118493 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.118592 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.118825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.118925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.119139 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.119236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.119451 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.119599 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.119792 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.119883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.120104 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.120193 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.120415 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.120512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.120728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.120827 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.121043 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.121207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.121355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.121459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.121667 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.121820 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.121978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.122150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.122310 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.122475 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.122620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.122910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.123001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.123240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.123330 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.123570 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.123665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.123886 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.123977 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.124196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.124285 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.124596 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.125233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.125412 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.125530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.125747 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.125918 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.126070 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.126169 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.126404 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.126495 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.126741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.126849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.127059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.127159 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.127388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.127485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.127736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.127844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.128059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.128150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.128380 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.128471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.128701 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.128804 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.129023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.129114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.129343 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.129456 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.129662 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.129796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.129977 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.130123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.130297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.130460 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.130619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.130803 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.130940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.131129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.131451 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.131571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.131802 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.131901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.132124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.132215 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.132446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.132537 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.132763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.132854 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.133083 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.133174 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.133399 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.133503 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.133717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.133808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.134034 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.134132 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.134351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.134450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.134668 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.134805 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.135004 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.135094 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.135329 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.135464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.135686 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.135812 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.136016 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.136113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.136343 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.136435 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.136666 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.136756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.136985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.137084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.137313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.137412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.137635 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.137732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.137959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.138049 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.138282 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.138374 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.138602 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.138700 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.138924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.139023 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.139244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.139334 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.139588 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.139684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.139909 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.140014 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.140305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.140404 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.140633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.140731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.140983 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.141084 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.141299 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.141387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.141619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.141724 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.141942 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.142034 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.142277 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.142379 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.142596 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.142698 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.142917 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.143054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.143284 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.143416 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.143590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.143679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.143884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.143984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.144205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.144459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.144550 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.144783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.144931 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.145126 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.145224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.145450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.145574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.145782 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.145907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.146098 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.146188 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.146422 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.146545 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.146746 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.146837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.147057 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.147154 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.147374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.147471 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.147715 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.147816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.148032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.148134 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.148344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.148434 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.148675 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.148768 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.148994 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.149084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.149307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.149448 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.149636 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.149726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.149953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.150052 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.150314 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.150492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.150647 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.150852 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.150959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.151177 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.151277 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.151542 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.151651 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.151866 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.151958 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.152190 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.152294 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.152505 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.152607 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.152837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.152929 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.153155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.153260 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.153470 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.153568 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.153794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.153895 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.154112 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.154362 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.154462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.154706 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.154806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.155027 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.155124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.155344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.155435 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.155681 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.155798 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.156024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.156168 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.156338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.156430 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.156662 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.156751 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.156971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.157071 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.157289 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.157381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.157602 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.157694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.157921 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.158021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.158231 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.158322 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.158544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.158642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.158853 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.158953 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.159162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.159255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.159482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.159629 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.159814 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.159907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.160130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.160222 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.160443 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.160573 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.160761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.160904 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.161071 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.161228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.161387 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.161556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.161696 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.161886 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.162027 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.162216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.162339 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.162546 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.162653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.162877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.162997 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.163211 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.163308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.163563 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.163678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.163893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.163992 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.164218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.164315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.164548 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.164646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.164877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.164984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.165228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.165413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.165578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.165805 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.165942 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.166136 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.166228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.166487 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.166580 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.166838 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.166980 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.167155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.167379 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.167480 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.167741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.167834 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.168093 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.168185 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.168420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.168511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.168739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.168830 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.169056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.169147 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.169373 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.169465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.169689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.169789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.170006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.170097 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.170322 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.170414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.170638 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.170729 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.170956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.171047 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.171272 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.171889 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.172147 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.172248 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.172474 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.172578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.172793 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.172891 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.173113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.173215 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.173439 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.173551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.173759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.173994 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.174115 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.174366 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.174466 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.174691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.174802 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.175013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.175105 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.175356 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.175464 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.175703 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.175838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.176018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.176137 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.176364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.176472 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.176691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.176790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.177015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.177105 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.177350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.177451 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.177678 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.177771 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.178000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.178097 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.178323 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.178428 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.178641 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.178731 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.178963 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.179060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.179279 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.179378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.179626 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.179720 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.179949 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.180052 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.180290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.180383 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.180610 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.180709 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.180925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.181015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.181240 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.181332 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.181553 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.181652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.181871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.182036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.182191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.182291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.182512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.182604 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.182832 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.182932 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.183160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.183251 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.183479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.183611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.183825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.183934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.184145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.184236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.184472 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.184573 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.184792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.184901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.185119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.185209 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.185439 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.185531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.185773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.185864 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.186089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.186226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.186408 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.186505 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.186727 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.186826 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.187097 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.187746 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.187951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.188043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.188271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.188371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.188602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.188692 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.188936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.189026 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.189254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.189353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.189587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.189819 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.189952 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.190223 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.190351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.190544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.190636 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.190864 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.190965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.191207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.191307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.191546 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.191655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.191872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.192015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.192191 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.192292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.192510 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.192601 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.192833 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.192936 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.193156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.193245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.193481 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.193572 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.193806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.193910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.194131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.194225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.194456 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.194547 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.194783 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.194884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.195113 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.195205 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.195438 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.195584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.195813 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.195924 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.196137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.196264 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.196459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.196552 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.196807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.196903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.197083 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 14:12:20.197173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.197708 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.198036 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.198362 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.198687 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.199013 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.199346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.199721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.200053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.200375 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.200813 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.201141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.201478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.201813 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.202141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.202480 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.202846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.203176 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.203538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.203870 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.204216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.204571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.204915 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.205261 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.205581 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.205904 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.206225 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.206617 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.206894 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.207240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.208161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.208161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.208378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.208570 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.208895 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.209233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.209568 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.209897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.210221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.210569 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.210897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.211224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.211572 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.211902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.212227 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.212552 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.212898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.213239 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.213564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.213906 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.214240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.215742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.215742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.215742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.215742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.216264 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.216344 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.216756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.216985 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.217315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.217652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.217999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.218373 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.218721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.219067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.219432 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.219747 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_db.sqlalchemy.engines [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:12:20.219849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.220142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.220488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.220819 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.221140 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.221462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 14:12:20.221719 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 14:12:20.244441 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_db.sqlalchemy.engines [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:12:20.286570 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.context [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc1cee38-301e-4e07-ba65-d2dc69c9d82f(cell1) {{(pid=116474) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 14:12:20.290830 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:12:20.292437 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:12:20.293247 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:12:20.295172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:12:20.306116 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_db.sqlalchemy.engines [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:12:20.307989 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_db.sqlalchemy.engines [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:12:20.311715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.context [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc1cee38-301e-4e07-ba65-d2dc69c9d82f(cell1) {{(pid=116475) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 14:12:20.316663 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:12:20.318250 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:12:20.319079 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:12:20.321086 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:12:20.331857 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_db.sqlalchemy.engines [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:12:20.332698 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_db.sqlalchemy.engines [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:12:20.472077 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_db.sqlalchemy.engines [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:12:20.494101 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_db.sqlalchemy.engines [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 14:12:20.800292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: WARNING keystonemiddleware.auth_token [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 14:12:20.806788 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: WARNING keystonemiddleware.auth_token [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 14:12:20.818816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: WARNING keystonemiddleware.auth_token [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 14:12:20.825564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: WARNING keystonemiddleware.auth_token [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 14:12:21.155276 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: WARNING keystonemiddleware.auth_token [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 14:12:21.161119 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: WARNING keystonemiddleware.auth_token [None req-93a5c353-12b6-4cbf-9456-d4c4c346db14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 14:12:21.166485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e75a8629c0 pid: 116474 (default app) Jan 11 14:12:21.170970 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: WARNING keystonemiddleware.auth_token [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 14:12:21.176726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: WARNING keystonemiddleware.auth_token [None req-18a8c7ce-7f09-4ec0-900c-115e992435fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 14:12:21.182096 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e75a8629c0 pid: 116475 (default app) Jan 11 14:12:58.602595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-076c1458-51e3-4e3f-aed1-e517cff6dab7 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba9318e700>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:12:58.992664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-076c1458-51e3-4e3f-aed1-e517cff6dab7 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9aa3cafb-ce5a-41ed-b358-b504e981a234" status: 200 len: 350 microversion: 2.1 time: 0.618977 Jan 11 14:12:58.994270 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 1/1] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:12:58 2022] GET /compute/v2.1/os-volumes/9aa3cafb-ce5a-41ed-b358-b504e981a234 => generated 350 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:12:59.930098 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1645193371", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "af1ef159-4151-46fa-bf26-34e9296d0c02"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:00.627303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3d65a423-5a15-4238-8444-5b10e026f860 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba9304f5e0>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:00.641117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] validate_networks() for [('af1ef159-4151-46fa-bf26-34e9296d0c02', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:13:00.715694 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3d65a423-5a15-4238-8444-5b10e026f860 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2ab31e1c-4c76-4998-b304-986351901db8" status: 200 len: 349 microversion: 2.1 time: 0.092874 Jan 11 14:13:00.718027 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 2/2] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:13:00 2022] GET /compute/v2.1/os-volumes/2ab31e1c-4c76-4998-b304-986351901db8 => generated 349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:02.261486 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:13:02.263292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:13:02.264744 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:13:02.265794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:13:02.266463 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:13:02.307122 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:02.307782 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:02.308836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:02.309434 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:02.360245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Getting quotas for project 78b47db2a2314b9d80eb556d0bae99aa. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:02.369183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Getting quotas for user bbd9aef0ef294e2eafd4ab8508d76373 and project 78b47db2a2314b9d80eb556d0bae99aa. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:02.400952 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:13:02.404117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:13:02.573207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f20173fc-c45a-43b7-bdc6-82ae629f19b7 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.395745 Jan 11 14:13:02.574368 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:12:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:13:02.585538 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0b1ce1ef-01c3-4d7b-a483-146f095a8fa3 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:02.586307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0b1ce1ef-01c3-4d7b-a483-146f095a8fa3 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:02.820832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0b1ce1ef-01c3-4d7b-a483-146f095a8fa3 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:02.848098 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0b1ce1ef-01c3-4d7b-a483-146f095a8fa3 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1215 microversion: 2.1 time: 0.266062 Jan 11 14:13:02.869557 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:02 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1215 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:03.868870 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0e1183c5-22e4-4b8f-ab46-c976e6a3688d tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:03.870274 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0e1183c5-22e4-4b8f-ab46-c976e6a3688d tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:04.063232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0e1183c5-22e4-4b8f-ab46-c976e6a3688d tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:04.086668 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0e1183c5-22e4-4b8f-ab46-c976e6a3688d tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1215 microversion: 2.1 time: 0.225263 Jan 11 14:13:04.115999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 2/5] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:03 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:04.626556 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-868656982", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e39c23a3-bd49-4a6e-99a6-de49e0477fd9"}]}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:04.805738 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] validate_networks() for [('e39c23a3-bd49-4a6e-99a6-de49e0477fd9', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:13:05.118481 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d30d5ff8-966f-411b-9d43-539528c2d258 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:05.120580 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d30d5ff8-966f-411b-9d43-539528c2d258 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:05.130604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d30d5ff8-966f-411b-9d43-539528c2d258 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:05.131453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d30d5ff8-966f-411b-9d43-539528c2d258 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:05.132736 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d30d5ff8-966f-411b-9d43-539528c2d258 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:05.133425 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d30d5ff8-966f-411b-9d43-539528c2d258 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:05.506510 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d30d5ff8-966f-411b-9d43-539528c2d258 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:05.530194 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d30d5ff8-966f-411b-9d43-539528c2d258 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1219 microversion: 2.1 time: 0.414414 Jan 11 14:13:05.532037 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:05 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1219 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:05.695983 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3b533fa9-3bd8-4278-864f-85206f7f9bb8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'create', calling method: .version_select at 0x7fba939aa1f0>, body: {"keypair": {"name": "tempest-keypair-242667538"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:05.760410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-3b533fa9-3bd8-4278-864f-85206f7f9bb8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for project 3a11f6957ee74ff0a62315613ff54913. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:05.774765 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-3b533fa9-3bd8-4278-864f-85206f7f9bb8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for user 67b016e5f2694c90821eb0eb80e3dc79 and project 3a11f6957ee74ff0a62315613ff54913. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:06.240675 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:13:06.241237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:13:06.241564 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:13:06.241969 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:13:06.242379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:13:06.277477 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:06.281416 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:06.283196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:06.292460 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:06.367660 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Getting quotas for project ac8a41f764014f4d95c74c7348ca537e. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:06.374337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Getting quotas for user c667ca8d78ed4288a36745cde5436283 and project ac8a41f764014f4d95c74c7348ca537e. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:06.419330 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:13:06.428756 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:13:06.558982 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1de7e719-5df7-40b4-b619-c1995562a5fd tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.045547 Jan 11 14:13:06.560223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 4/7] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:13:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:13:06.577218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9781cefd-8a22-464c-bcde-ba8c2f19cbef tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:06.585204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9781cefd-8a22-464c-bcde-ba8c2f19cbef tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:06.610928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9781cefd-8a22-464c-bcde-ba8c2f19cbef tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:06.613803 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9781cefd-8a22-464c-bcde-ba8c2f19cbef tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:06.615006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9781cefd-8a22-464c-bcde-ba8c2f19cbef tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:06.617622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9781cefd-8a22-464c-bcde-ba8c2f19cbef tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:06.996384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9781cefd-8a22-464c-bcde-ba8c2f19cbef tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:07.015096 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9781cefd-8a22-464c-bcde-ba8c2f19cbef tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1267 microversion: 2.1 time: 0.448995 Jan 11 14:13:07.034601 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:06 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1267 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:07.048137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3f71dea6-782c-45b8-9dd9-003f5756bfa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:07.049779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3f71dea6-782c-45b8-9dd9-003f5756bfa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:07.190046 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3f71dea6-782c-45b8-9dd9-003f5756bfa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:07.200677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3f71dea6-782c-45b8-9dd9-003f5756bfa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1221 microversion: 2.1 time: 0.164937 Jan 11 14:13:07.203409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 6/9] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:07 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1221 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:07.339860 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1975973086", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e39c23a3-bd49-4a6e-99a6-de49e0477fd9"}]}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:07.522668 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] validate_networks() for [('e39c23a3-bd49-4a6e-99a6-de49e0477fd9', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:13:07.645760 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-3b533fa9-3bd8-4278-864f-85206f7f9bb8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for project 3a11f6957ee74ff0a62315613ff54913. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:07.661538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-3b533fa9-3bd8-4278-864f-85206f7f9bb8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for user 67b016e5f2694c90821eb0eb80e3dc79 and project 3a11f6957ee74ff0a62315613ff54913. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:07.710578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3b533fa9-3bd8-4278-864f-85206f7f9bb8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 2.173378 Jan 11 14:13:07.742674 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 4/10] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Jan 11 14:13:05 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:07.999255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0208b70e-2aaa-4c78-8a3f-ce689bfacb1b tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba91ea0ca0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:08.346494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0208b70e-2aaa-4c78-8a3f-ce689bfacb1b tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4b2f9303-a660-4434-8b59-1260099b3208" status: 200 len: 351 microversion: 2.1 time: 0.352230 Jan 11 14:13:08.347467 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 5/11] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:13:07 2022] GET /compute/v2.1/os-volumes/4b2f9303-a660-4434-8b59-1260099b3208 => generated 351 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:08.353504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-17eb845d-71d6-45fd-94d8-cadee422fa23 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:08.354529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-17eb845d-71d6-45fd-94d8-cadee422fa23 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:08.371029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-17eb845d-71d6-45fd-94d8-cadee422fa23 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:08.378441 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-17eb845d-71d6-45fd-94d8-cadee422fa23 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:08.380127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-17eb845d-71d6-45fd-94d8-cadee422fa23 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:08.382220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-17eb845d-71d6-45fd-94d8-cadee422fa23 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:08.662562 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-17eb845d-71d6-45fd-94d8-cadee422fa23 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:08.678738 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-17eb845d-71d6-45fd-94d8-cadee422fa23 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1273 microversion: 2.1 time: 0.325050 Jan 11 14:13:08.691948 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:08 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:08.706968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d865345b-0a33-429b-80f5-e7fe8adacd70 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba915b84c0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:09.019626 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d865345b-0a33-429b-80f5-e7fe8adacd70 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.331606 Jan 11 14:13:09.020535 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1133 bytes} [Tue Jan 11 14:13:08 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:09.038639 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a3da13b1-8426-434e-b216-f31f2d20f99a tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba915c5e50>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:09.197287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:13:09.198363 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:13:09.198966 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:13:09.199626 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:13:09.200254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:13:09.218429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:09.224862 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:09.225942 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:09.228193 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:09.277622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Getting quotas for project ac8a41f764014f4d95c74c7348ca537e. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:09.287795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Getting quotas for user c667ca8d78ed4288a36745cde5436283 and project ac8a41f764014f4d95c74c7348ca537e. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:09.292575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a3da13b1-8426-434e-b216-f31f2d20f99a tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.261488 Jan 11 14:13:09.293470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 8/14] 10.222.0.49 () {58 vars in 1148 bytes} [Tue Jan 11 14:13:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:09.314829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:13:09.333530 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:13:09.379564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-45c042f1-46a7-48fa-bac6-8a54ea3f4d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'create', calling method: .version_select at 0x7fba915c5dc0>, body: {"keypair": {"name": "tempest-keypair-717146029"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:09.393095 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-407ec4d3-5a2a-4327-bf5d-f9c3e7643419 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.062353 Jan 11 14:13:09.400271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 7/15] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:13:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:13:09.406478 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-55ab6d78-169b-4579-b8dc-b5e24786d9e8 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba91e3baf0>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:09.406996 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-45c042f1-46a7-48fa-bac6-8a54ea3f4d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:09.415553 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-45c042f1-46a7-48fa-bac6-8a54ea3f4d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for user 505b3b6c502d4deea89170e2dba2a029 and project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:09.566562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-55ab6d78-169b-4579-b8dc-b5e24786d9e8 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.164117 Jan 11 14:13:09.567720 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1133 bytes} [Tue Jan 11 14:13:09 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:09.575140 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-603ca69d-ae23-4749-8648-693d5280b7af tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:09.580968 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-603ca69d-ae23-4749-8648-693d5280b7af tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:09.674708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-603ca69d-ae23-4749-8648-693d5280b7af tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:09.682513 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-603ca69d-ae23-4749-8648-693d5280b7af tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1222 microversion: 2.1 time: 0.113302 Jan 11 14:13:09.696983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 9/17] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:09 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:09.716036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1e22ece0-267f-48bf-b635-249ce6a14ab2 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba91e01b80>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:09.891406 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1e22ece0-267f-48bf-b635-249ce6a14ab2 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.190153 Jan 11 14:13:09.892774 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 10/18] 10.222.0.49 () {58 vars in 1166 bytes} [Tue Jan 11 14:13:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:09.898685 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-54a0d30f-1298-4d9b-86ac-ffb1c42c3f54 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:09.899318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-54a0d30f-1298-4d9b-86ac-ffb1c42c3f54 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:09.925644 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-54a0d30f-1298-4d9b-86ac-ffb1c42c3f54 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:09.930014 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-54a0d30f-1298-4d9b-86ac-ffb1c42c3f54 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:09.933579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-54a0d30f-1298-4d9b-86ac-ffb1c42c3f54 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:09.936287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-54a0d30f-1298-4d9b-86ac-ffb1c42c3f54 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:10.157485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-54a0d30f-1298-4d9b-86ac-ffb1c42c3f54 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:10.158375 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-45c042f1-46a7-48fa-bac6-8a54ea3f4d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:10.171120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-45c042f1-46a7-48fa-bac6-8a54ea3f4d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for user 505b3b6c502d4deea89170e2dba2a029 and project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:10.171708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-54a0d30f-1298-4d9b-86ac-ffb1c42c3f54 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1273 microversion: 2.1 time: 0.274725 Jan 11 14:13:10.174018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 11/19] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:09 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:10.187534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4e1435fb-9472-4ac0-a3dd-e63ca155730b tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba91e21430>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:10.217844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-45c042f1-46a7-48fa-bac6-8a54ea3f4d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.920940 Jan 11 14:13:10.218489 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 9/20] 10.222.0.49 () {62 vars in 1198 bytes} [Tue Jan 11 14:13:09 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 924 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 11 14:13:10.337166 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4e1435fb-9472-4ac0-a3dd-e63ca155730b tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.161591 Jan 11 14:13:10.338128 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 12/21] 10.222.0.49 () {58 vars in 1169 bytes} [Tue Jan 11 14:13:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:10.350618 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a51e5604-2bf9-4959-a48f-8803f1bfd93e tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba915b8b80>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:10.519828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a51e5604-2bf9-4959-a48f-8803f1bfd93e tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.173558 Jan 11 14:13:10.523604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 10/22] 10.222.0.49 () {58 vars in 1154 bytes} [Tue Jan 11 14:13:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:10.532600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-96750f3b-5596-41a9-ba27-5a130439d0dc tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba91e64820>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:10.699605 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-96750f3b-5596-41a9-ba27-5a130439d0dc tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.171254 Jan 11 14:13:10.706573 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 13/23] 10.222.0.49 () {58 vars in 1187 bytes} [Tue Jan 11 14:13:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:10.720793 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-81cf869d-5840-4679-ae2b-9a7b288b9ff5 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] Calling method '.version_select at 0x7fba915c8550>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:10.724283 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6865c611-652b-444f-8e11-2421f0951a58 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:10.726170 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6865c611-652b-444f-8e11-2421f0951a58 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:10.744291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6865c611-652b-444f-8e11-2421f0951a58 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:10.744991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6865c611-652b-444f-8e11-2421f0951a58 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:10.747733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6865c611-652b-444f-8e11-2421f0951a58 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:10.748940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6865c611-652b-444f-8e11-2421f0951a58 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:10.904575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-81cf869d-5840-4679-ae2b-9a7b288b9ff5 tempest-VolumesTestJSON-1308323469 tempest-VolumesTestJSON-1308323469-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.195685 Jan 11 14:13:10.904916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6865c611-652b-444f-8e11-2421f0951a58 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:10.905911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1154 bytes} [Tue Jan 11 14:13:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:10.922964 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6865c611-652b-444f-8e11-2421f0951a58 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1226 microversion: 2.1 time: 0.210718 Jan 11 14:13:10.933896 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 14/25] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:10 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1226 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:11.188444 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2d3bc1bd-1536-4a6e-9ddd-07ce8acf2823 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:11.189687 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2d3bc1bd-1536-4a6e-9ddd-07ce8acf2823 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:11.200223 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2d3bc1bd-1536-4a6e-9ddd-07ce8acf2823 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:11.202530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2d3bc1bd-1536-4a6e-9ddd-07ce8acf2823 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:11.203599 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2d3bc1bd-1536-4a6e-9ddd-07ce8acf2823 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:11.205483 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2d3bc1bd-1536-4a6e-9ddd-07ce8acf2823 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:11.553807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2d3bc1bd-1536-4a6e-9ddd-07ce8acf2823 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:11.601533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2d3bc1bd-1536-4a6e-9ddd-07ce8acf2823 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1273 microversion: 2.1 time: 0.404487 Jan 11 14:13:11.602945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:11 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1273 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:11.778440 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1264985835", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b91e79a-b551-4734-8a4b-8bd89379e2e4"}], "security_groups": [{"name": "tempest-securitygroup--421586489"}], "key_name": "tempest-keypair-242667538", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:11.945093 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dd7c4073-efdd-44dc-8053-13b2bc8ca820 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:11.946326 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dd7c4073-efdd-44dc-8053-13b2bc8ca820 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:11.961369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd7c4073-efdd-44dc-8053-13b2bc8ca820 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:11.962628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd7c4073-efdd-44dc-8053-13b2bc8ca820 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:11.967362 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd7c4073-efdd-44dc-8053-13b2bc8ca820 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:11.970914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd7c4073-efdd-44dc-8053-13b2bc8ca820 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:12.060304 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] validate_networks() for [('0b91e79a-b551-4734-8a4b-8bd89379e2e4', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:13:12.267070 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dd7c4073-efdd-44dc-8053-13b2bc8ca820 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:12.275388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dd7c4073-efdd-44dc-8053-13b2bc8ca820 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1226 microversion: 2.1 time: 0.337583 Jan 11 14:13:12.286153 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:11 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1226 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:12.618363 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f65c8867-3678-456c-8e57-a36dfb681951 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:12.619358 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f65c8867-3678-456c-8e57-a36dfb681951 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:12.629129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f65c8867-3678-456c-8e57-a36dfb681951 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:12.630697 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f65c8867-3678-456c-8e57-a36dfb681951 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:12.638645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f65c8867-3678-456c-8e57-a36dfb681951 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:12.641691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f65c8867-3678-456c-8e57-a36dfb681951 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:12.826494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f65c8867-3678-456c-8e57-a36dfb681951 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:12.846134 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f65c8867-3678-456c-8e57-a36dfb681951 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1273 microversion: 2.1 time: 0.231451 Jan 11 14:13:12.866913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 14/28] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:12 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:13.120951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:13:13.122178 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:13:13.122977 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:13:13.123947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:13:13.124754 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:13:13.140756 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:13.142652 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:13.144415 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:13.145677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:13.178773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for project 3a11f6957ee74ff0a62315613ff54913. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:13.184992 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for user 67b016e5f2694c90821eb0eb80e3dc79 and project 3a11f6957ee74ff0a62315613ff54913. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:13.200740 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:13:13.204292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:13:13.292418 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2045dc95-65e4-4c4f-8409-dc0787af9c3d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:13.293883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2045dc95-65e4-4c4f-8409-dc0787af9c3d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:13.300940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0618455c-2085-4f41-8199-f3b7abc58b3f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.524336 Jan 11 14:13:13.304181 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2045dc95-65e4-4c4f-8409-dc0787af9c3d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:13.304395 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 15/29] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:13:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:13:13.307203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2045dc95-65e4-4c4f-8409-dc0787af9c3d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:13.308280 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2045dc95-65e4-4c4f-8409-dc0787af9c3d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:13.308888 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2045dc95-65e4-4c4f-8409-dc0787af9c3d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:13.318759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-be87271f-e18c-470c-b7be-dae523f82d26 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:13.320718 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-be87271f-e18c-470c-b7be-dae523f82d26 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:13.464118 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-be87271f-e18c-470c-b7be-dae523f82d26 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:13.477109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-be87271f-e18c-470c-b7be-dae523f82d26 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1237 microversion: 2.1 time: 0.166891 Jan 11 14:13:13.483587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 16/30] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:13 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1237 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:13.549412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2045dc95-65e4-4c4f-8409-dc0787af9c3d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:13.571454 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2045dc95-65e4-4c4f-8409-dc0787af9c3d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1218 microversion: 2.1 time: 0.280800 Jan 11 14:13:13.575638 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 15/31] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:13 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1218 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:13.865966 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-207dc872-4e35-4781-bdd8-e69d616d2aad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:13.879764 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-207dc872-4e35-4781-bdd8-e69d616d2aad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:13.879764 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-207dc872-4e35-4781-bdd8-e69d616d2aad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:13.879764 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-207dc872-4e35-4781-bdd8-e69d616d2aad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:13.879764 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-207dc872-4e35-4781-bdd8-e69d616d2aad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:13.880328 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-207dc872-4e35-4781-bdd8-e69d616d2aad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:14.097386 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-207dc872-4e35-4781-bdd8-e69d616d2aad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:14.124091 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-207dc872-4e35-4781-bdd8-e69d616d2aad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1273 microversion: 2.1 time: 0.261518 Jan 11 14:13:14.139765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 17/32] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:13 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:14.505309 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-70fbbdc3-dc8b-4457-9288-35ceecfd0941 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:14.507382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-70fbbdc3-dc8b-4457-9288-35ceecfd0941 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:14.526230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-70fbbdc3-dc8b-4457-9288-35ceecfd0941 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:14.526733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-70fbbdc3-dc8b-4457-9288-35ceecfd0941 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:14.533080 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-70fbbdc3-dc8b-4457-9288-35ceecfd0941 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:14.533538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-70fbbdc3-dc8b-4457-9288-35ceecfd0941 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:14.591726 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a915ac98-53da-43a5-b22c-fe5050b6b652 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:14.592794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a915ac98-53da-43a5-b22c-fe5050b6b652 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:14.617219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a915ac98-53da-43a5-b22c-fe5050b6b652 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:14.617545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a915ac98-53da-43a5-b22c-fe5050b6b652 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:14.618418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a915ac98-53da-43a5-b22c-fe5050b6b652 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:14.618869 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a915ac98-53da-43a5-b22c-fe5050b6b652 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:14.974027 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-70fbbdc3-dc8b-4457-9288-35ceecfd0941 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:14.995180 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-70fbbdc3-dc8b-4457-9288-35ceecfd0941 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1241 microversion: 2.1 time: 0.500464 Jan 11 14:13:15.003723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 16/33] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:14 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1241 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:15.141576 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-19d80af2-0309-4386-955a-ba73b68e29a6 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:15.142795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-19d80af2-0309-4386-955a-ba73b68e29a6 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:15.169199 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-19d80af2-0309-4386-955a-ba73b68e29a6 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:15.173562 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-19d80af2-0309-4386-955a-ba73b68e29a6 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:15.179984 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-19d80af2-0309-4386-955a-ba73b68e29a6 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:15.181614 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-19d80af2-0309-4386-955a-ba73b68e29a6 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:15.449719 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a915ac98-53da-43a5-b22c-fe5050b6b652 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:15.461426 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a915ac98-53da-43a5-b22c-fe5050b6b652 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1274 microversion: 2.1 time: 0.873287 Jan 11 14:13:15.469769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 18/34] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:14 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1274 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:16.038156 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d6f1e8b6-b69b-4aa3-836d-f344767fa691 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:16.039908 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d6f1e8b6-b69b-4aa3-836d-f344767fa691 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:16.063400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d6f1e8b6-b69b-4aa3-836d-f344767fa691 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:16.070558 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d6f1e8b6-b69b-4aa3-836d-f344767fa691 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:16.072514 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d6f1e8b6-b69b-4aa3-836d-f344767fa691 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:16.076669 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d6f1e8b6-b69b-4aa3-836d-f344767fa691 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:16.552282 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d6f1e8b6-b69b-4aa3-836d-f344767fa691 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:16.591743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d6f1e8b6-b69b-4aa3-836d-f344767fa691 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1289 microversion: 2.1 time: 0.579060 Jan 11 14:13:16.623905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 19/35] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:16 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1289 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:16.651298 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-db7dbe5c-6779-4149-9d6f-f741cf65dcd2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:16.651983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-db7dbe5c-6779-4149-9d6f-f741cf65dcd2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:16.694799 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db7dbe5c-6779-4149-9d6f-f741cf65dcd2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:16.694799 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db7dbe5c-6779-4149-9d6f-f741cf65dcd2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:16.694799 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db7dbe5c-6779-4149-9d6f-f741cf65dcd2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:16.694799 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db7dbe5c-6779-4149-9d6f-f741cf65dcd2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:17.052185 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-19d80af2-0309-4386-955a-ba73b68e29a6 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:17.077126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-19d80af2-0309-4386-955a-ba73b68e29a6 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 1.937248 Jan 11 14:13:17.078212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 17/36] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:15 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:17.101622 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-32666122", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63c4d627-31e2-452f-a693-3a2f1117c04e"}], "security_groups": [{"name": "tempest-securitygroup--1619066849"}], "key_name": "tempest-keypair-717146029", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:17.262049 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-db7dbe5c-6779-4149-9d6f-f741cf65dcd2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:17.284025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-db7dbe5c-6779-4149-9d6f-f741cf65dcd2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1280 microversion: 2.1 time: 0.657345 Jan 11 14:13:17.285410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 20/37] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:16 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1280 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:17.352885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] validate_networks() for [('63c4d627-31e2-452f-a693-3a2f1117c04e', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:13:17.622912 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-27f2e3a2-bae0-4939-9fc5-5337e1b33443 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:17.624271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-27f2e3a2-bae0-4939-9fc5-5337e1b33443 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:17.634360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27f2e3a2-bae0-4939-9fc5-5337e1b33443 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:17.638732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27f2e3a2-bae0-4939-9fc5-5337e1b33443 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:17.640344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27f2e3a2-bae0-4939-9fc5-5337e1b33443 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:17.641997 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27f2e3a2-bae0-4939-9fc5-5337e1b33443 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:17.781976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-27f2e3a2-bae0-4939-9fc5-5337e1b33443 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:17.796779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-27f2e3a2-bae0-4939-9fc5-5337e1b33443 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1295 microversion: 2.1 time: 0.178165 Jan 11 14:13:17.797955 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 21/38] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:17 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1295 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:18.095008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-10684f01-6a6a-413f-b423-e6209935f64f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:18.096041 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-10684f01-6a6a-413f-b423-e6209935f64f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:18.107867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-10684f01-6a6a-413f-b423-e6209935f64f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:18.132435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-10684f01-6a6a-413f-b423-e6209935f64f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:18.133970 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-10684f01-6a6a-413f-b423-e6209935f64f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:18.134653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-10684f01-6a6a-413f-b423-e6209935f64f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:18.862837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-10684f01-6a6a-413f-b423-e6209935f64f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:18.875286 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-10684f01-6a6a-413f-b423-e6209935f64f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.783216 Jan 11 14:13:18.876967 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 22/39] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:18 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:18.891975 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-31ad99ff-8070-4993-91a7-acf0daa2c297 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:18.892998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-31ad99ff-8070-4993-91a7-acf0daa2c297 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:18.900015 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-31ad99ff-8070-4993-91a7-acf0daa2c297 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:18.900852 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-31ad99ff-8070-4993-91a7-acf0daa2c297 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:18.902146 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-31ad99ff-8070-4993-91a7-acf0daa2c297 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:18.902830 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-31ad99ff-8070-4993-91a7-acf0daa2c297 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:18.991530 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-31ad99ff-8070-4993-91a7-acf0daa2c297 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:19.014458 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-31ad99ff-8070-4993-91a7-acf0daa2c297 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1280 microversion: 2.1 time: 0.126390 Jan 11 14:13:19.015832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 23/40] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:18 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:19.022080 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7bed7f9a-cf74-457d-9391-9bd8eed41b6d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:19.022698 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7bed7f9a-cf74-457d-9391-9bd8eed41b6d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:19.038500 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bed7f9a-cf74-457d-9391-9bd8eed41b6d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:19.038962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bed7f9a-cf74-457d-9391-9bd8eed41b6d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:19.039801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bed7f9a-cf74-457d-9391-9bd8eed41b6d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:19.040240 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bed7f9a-cf74-457d-9391-9bd8eed41b6d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:19.250917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7bed7f9a-cf74-457d-9391-9bd8eed41b6d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:19.258772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7bed7f9a-cf74-457d-9391-9bd8eed41b6d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1295 microversion: 2.1 time: 0.241907 Jan 11 14:13:19.259352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 24/41] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:19 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1295 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:19.635835 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:13:19.636241 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:13:19.636408 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:13:19.636750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:13:19.637452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:13:19.652919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:19.656029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:19.658504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:19.659245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:19.678395 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:13:19.683811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for user 505b3b6c502d4deea89170e2dba2a029 and project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:13:19.718081 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:13:19.726695 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:13:19.816462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-87073849-465b-4fdc-be14-af2bf38e70c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.732833 Jan 11 14:13:19.821896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 18/42] 10.222.0.49 () {62 vars in 1187 bytes} [Tue Jan 11 14:13:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2741 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 11 14:13:19.833241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-36f5a365-6caf-4a00-9039-1bde61010189 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:19.834098 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-36f5a365-6caf-4a00-9039-1bde61010189 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:19.895118 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d5b1944b-da7b-47f8-9d14-8ca5414f2f0e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:19.896218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d5b1944b-da7b-47f8-9d14-8ca5414f2f0e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:19.912186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5b1944b-da7b-47f8-9d14-8ca5414f2f0e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:19.912965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5b1944b-da7b-47f8-9d14-8ca5414f2f0e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:19.915882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5b1944b-da7b-47f8-9d14-8ca5414f2f0e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:19.917472 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5b1944b-da7b-47f8-9d14-8ca5414f2f0e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:19.987827 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-36f5a365-6caf-4a00-9039-1bde61010189 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:19.996423 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-36f5a365-6caf-4a00-9039-1bde61010189 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:19.999006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-36f5a365-6caf-4a00-9039-1bde61010189 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:20.000337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-36f5a365-6caf-4a00-9039-1bde61010189 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1279 microversion: 2.20 time: 0.172665 Jan 11 14:13:20.001796 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 25/43] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:19 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:20.036519 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e1b78cdb-086d-4586-b9ba-5732866cebef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:20.037155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e1b78cdb-086d-4586-b9ba-5732866cebef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:20.048736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1b78cdb-086d-4586-b9ba-5732866cebef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:20.049200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1b78cdb-086d-4586-b9ba-5732866cebef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:20.053071 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1b78cdb-086d-4586-b9ba-5732866cebef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:20.054132 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1b78cdb-086d-4586-b9ba-5732866cebef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:20.322006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e1b78cdb-086d-4586-b9ba-5732866cebef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:20.338135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e1b78cdb-086d-4586-b9ba-5732866cebef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1280 microversion: 2.1 time: 0.307039 Jan 11 14:13:20.352537 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 26/44] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:20 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:20.362327 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-45bf0cc2-a4c4-41f4-bace-af20f1732d5d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:20.369407 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-45bf0cc2-a4c4-41f4-bace-af20f1732d5d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:20.390296 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-45bf0cc2-a4c4-41f4-bace-af20f1732d5d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:20.390757 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-45bf0cc2-a4c4-41f4-bace-af20f1732d5d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:20.391579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-45bf0cc2-a4c4-41f4-bace-af20f1732d5d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:20.392291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-45bf0cc2-a4c4-41f4-bace-af20f1732d5d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:20.424113 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d5b1944b-da7b-47f8-9d14-8ca5414f2f0e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:20.437580 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d5b1944b-da7b-47f8-9d14-8ca5414f2f0e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.545887 Jan 11 14:13:20.439266 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 19/45] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:19 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:20.576601 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-45bf0cc2-a4c4-41f4-bace-af20f1732d5d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:20.605903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-45bf0cc2-a4c4-41f4-bace-af20f1732d5d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1295 microversion: 2.1 time: 0.251744 Jan 11 14:13:20.634137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 27/46] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:20 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1295 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:21.018739 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:21.019355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:21.027666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:21.029968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:21.032372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:21.032992 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:21.150703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:21.160622 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:21.162492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:21.165383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8a9af23f-4f27-49fb-a9f8-2cdbe1becdc5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1283 microversion: 2.20 time: 0.148835 Jan 11 14:13:21.176834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 20/47] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:21 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1283 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:21.353994 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-93f94d0c-b4ed-419b-9464-0d50c225de12 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:21.354602 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-93f94d0c-b4ed-419b-9464-0d50c225de12 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:21.362261 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93f94d0c-b4ed-419b-9464-0d50c225de12 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:21.362701 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93f94d0c-b4ed-419b-9464-0d50c225de12 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:21.363516 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93f94d0c-b4ed-419b-9464-0d50c225de12 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:21.363956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93f94d0c-b4ed-419b-9464-0d50c225de12 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:21.458784 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-313c8d3e-f4f1-4330-b03e-f5c48c1a371f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:21.459684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-313c8d3e-f4f1-4330-b03e-f5c48c1a371f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:21.472364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-313c8d3e-f4f1-4330-b03e-f5c48c1a371f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:21.483210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-313c8d3e-f4f1-4330-b03e-f5c48c1a371f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:21.485408 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-313c8d3e-f4f1-4330-b03e-f5c48c1a371f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:21.494343 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-313c8d3e-f4f1-4330-b03e-f5c48c1a371f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:22.216060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-93f94d0c-b4ed-419b-9464-0d50c225de12 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:22.236119 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-93f94d0c-b4ed-419b-9464-0d50c225de12 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.881377 Jan 11 14:13:22.248466 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 28/48] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:21 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:22.253584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-efe79327-5ffe-417d-88a8-0c13fb63b1c0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:22.254431 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-efe79327-5ffe-417d-88a8-0c13fb63b1c0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:22.264590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-efe79327-5ffe-417d-88a8-0c13fb63b1c0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:22.265634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-efe79327-5ffe-417d-88a8-0c13fb63b1c0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:22.266721 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-efe79327-5ffe-417d-88a8-0c13fb63b1c0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:22.268313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-efe79327-5ffe-417d-88a8-0c13fb63b1c0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:22.758213 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-313c8d3e-f4f1-4330-b03e-f5c48c1a371f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:22.766932 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-313c8d3e-f4f1-4330-b03e-f5c48c1a371f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 1.312629 Jan 11 14:13:22.768300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 21/49] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:21 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:22.774276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:22.775066 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:22.782951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:22.783729 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:22.785162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:22.785798 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:22.897226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-efe79327-5ffe-417d-88a8-0c13fb63b1c0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:22.908819 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-efe79327-5ffe-417d-88a8-0c13fb63b1c0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.658109 Jan 11 14:13:22.915782 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 29/50] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:22 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:23.069584 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:23.087862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:23.111398 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:23.113686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-28ca5d4f-2c67-49e2-a8f9-cab5b06020ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1331 microversion: 2.20 time: 0.344209 Jan 11 14:13:23.117946 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 22/51] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:22 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1331 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:23.243623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-9d1942d7-7d95-455f-bda0-d348f5aa13f4 req-9fc3b930-77cc-4dc8-aca1-ec418c1ac003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667829c5-ceaa-492a-8a6f-98dfd8155a4c", "tag": "c063d65b-930d-449b-91e5-7f64c92f6387"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:23.246058 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:13:23.246058 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:13:23.274111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-9d1942d7-7d95-455f-bda0-d348f5aa13f4 req-9fc3b930-77cc-4dc8-aca1-ec418c1ac003 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.276028 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-9d1942d7-7d95-455f-bda0-d348f5aa13f4 req-9fc3b930-77cc-4dc8-aca1-ec418c1ac003 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.332245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-9d1942d7-7d95-455f-bda0-d348f5aa13f4 req-9fc3b930-77cc-4dc8-aca1-ec418c1ac003 service nova] Creating event network-changed:c063d65b-930d-449b-91e5-7f64c92f6387 for instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c on hv-cinder-82413 Jan 11 14:13:23.333464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-9d1942d7-7d95-455f-bda0-d348f5aa13f4 req-9fc3b930-77cc-4dc8-aca1-ec418c1ac003 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 11 14:13:23.346421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9f3759-4cd3-474c-85cf-eb14151b7a7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.347144 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9f3759-4cd3-474c-85cf-eb14151b7a7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.349909 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9f3759-4cd3-474c-85cf-eb14151b7a7e None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.353006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9f3759-4cd3-474c-85cf-eb14151b7a7e None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.378927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.compute.rpcapi [None req-bd9f3759-4cd3-474c-85cf-eb14151b7a7e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 11 14:13:23.381601 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9f3759-4cd3-474c-85cf-eb14151b7a7e None None] Releasing lock "compute-rpcapi-router" {{(pid=116474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 11 14:13:23.429892 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bd9f3759-4cd3-474c-85cf-eb14151b7a7e None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.510169 Jan 11 14:13:23.430921 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 30/52] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:23.440163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3b0e8dd2-f3ec-4a73-8071-ab0e7183c5d0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:23.443371 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3b0e8dd2-f3ec-4a73-8071-ab0e7183c5d0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:23.462109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3b0e8dd2-f3ec-4a73-8071-ab0e7183c5d0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.462984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3b0e8dd2-f3ec-4a73-8071-ab0e7183c5d0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.465438 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3b0e8dd2-f3ec-4a73-8071-ab0e7183c5d0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.467172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3b0e8dd2-f3ec-4a73-8071-ab0e7183c5d0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.690522 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-cce729c0-1b3f-4e1d-910c-1be7a0bb4487 req-aa8eb9e8-23be-4f82-82e0-0e1b876580a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efdb5bf8-cc2d-4e01-ad4d-6a9647801384", "tag": "77e99707-79d4-42da-8053-2f361200d181"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:23.693825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:13:23.693825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:13:23.721922 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-cce729c0-1b3f-4e1d-910c-1be7a0bb4487 req-aa8eb9e8-23be-4f82-82e0-0e1b876580a9 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.722676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-cce729c0-1b3f-4e1d-910c-1be7a0bb4487 req-aa8eb9e8-23be-4f82-82e0-0e1b876580a9 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.752258 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-cce729c0-1b3f-4e1d-910c-1be7a0bb4487 req-aa8eb9e8-23be-4f82-82e0-0e1b876580a9 service nova] Creating event network-changed:77e99707-79d4-42da-8053-2f361200d181 for instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 on hv-cinder-82413 Jan 11 14:13:23.753269 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-cce729c0-1b3f-4e1d-910c-1be7a0bb4487 req-aa8eb9e8-23be-4f82-82e0-0e1b876580a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 11 14:13:23.754680 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62481bd6-62d5-419a-a36a-1d565692c496 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.755293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62481bd6-62d5-419a-a36a-1d565692c496 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.756318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62481bd6-62d5-419a-a36a-1d565692c496 None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.756933 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62481bd6-62d5-419a-a36a-1d565692c496 None None] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.766593 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.compute.rpcapi [None req-62481bd6-62d5-419a-a36a-1d565692c496 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 11 14:13:23.768271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62481bd6-62d5-419a-a36a-1d565692c496 None None] Releasing lock "compute-rpcapi-router" {{(pid=116475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 11 14:13:23.800345 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-62481bd6-62d5-419a-a36a-1d565692c496 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.679106 Jan 11 14:13:23.801417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 23/53] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:23.806798 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-591230d4-8889-4355-afde-933472d5bfce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:23.808129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-591230d4-8889-4355-afde-933472d5bfce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:23.820572 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-591230d4-8889-4355-afde-933472d5bfce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.823398 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-591230d4-8889-4355-afde-933472d5bfce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:23.825663 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-591230d4-8889-4355-afde-933472d5bfce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:23.827525 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-591230d4-8889-4355-afde-933472d5bfce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:24.184871 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3b0e8dd2-f3ec-4a73-8071-ab0e7183c5d0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:24.195267 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-591230d4-8889-4355-afde-933472d5bfce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:24.200029 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3b0e8dd2-f3ec-4a73-8071-ab0e7183c5d0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.767148 Jan 11 14:13:24.201329 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 31/54] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:23 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:24.204698 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-591230d4-8889-4355-afde-933472d5bfce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.401877 Jan 11 14:13:24.205434 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 24/55] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:23 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:24.208954 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b655dc3e-819e-44b6-9a90-d921d93fbd25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:24.213490 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b655dc3e-819e-44b6-9a90-d921d93fbd25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:24.216285 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:24.220987 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:24.226809 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b655dc3e-819e-44b6-9a90-d921d93fbd25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:24.228378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b655dc3e-819e-44b6-9a90-d921d93fbd25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:24.230592 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b655dc3e-819e-44b6-9a90-d921d93fbd25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:24.231262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b655dc3e-819e-44b6-9a90-d921d93fbd25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:24.237019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:24.237781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:24.239305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:24.240121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:24.397572 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:24.415482 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:24.432472 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:24.434585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dffcfc97-742a-4c1f-9131-dbd8fbe4ead7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1337 microversion: 2.20 time: 0.228053 Jan 11 14:13:24.436478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 25/56] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:24 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1337 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:24.604925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b655dc3e-819e-44b6-9a90-d921d93fbd25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:24.616137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b655dc3e-819e-44b6-9a90-d921d93fbd25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.413619 Jan 11 14:13:24.616724 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 32/57] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:24 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:25.224437 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-458c8588-8c2a-43a5-ad0e-607b49447c5e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:25.227008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c10e5dd7-2a37-4430-a9a5-b116f4203bcb tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:25.227664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-458c8588-8c2a-43a5-ad0e-607b49447c5e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:25.228309 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c10e5dd7-2a37-4430-a9a5-b116f4203bcb tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:25.250918 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-458c8588-8c2a-43a5-ad0e-607b49447c5e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.252457 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-458c8588-8c2a-43a5-ad0e-607b49447c5e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.254315 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c10e5dd7-2a37-4430-a9a5-b116f4203bcb tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.254763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c10e5dd7-2a37-4430-a9a5-b116f4203bcb tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.255401 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-458c8588-8c2a-43a5-ad0e-607b49447c5e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.257265 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-458c8588-8c2a-43a5-ad0e-607b49447c5e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.259308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c10e5dd7-2a37-4430-a9a5-b116f4203bcb tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.259779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c10e5dd7-2a37-4430-a9a5-b116f4203bcb tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.719173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-458c8588-8c2a-43a5-ad0e-607b49447c5e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:25.729653 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-458c8588-8c2a-43a5-ad0e-607b49447c5e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.516210 Jan 11 14:13:25.730249 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 26/58] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:25 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:25.755138 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:25.756170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:25.762426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.763107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.764150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.764728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.895062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:25.903411 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:25.910319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:25.910947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c10e5dd7-2a37-4430-a9a5-b116f4203bcb tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:25.911868 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9782f670-4b10-4af4-8abc-4357b6f770b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1337 microversion: 2.20 time: 0.172426 Jan 11 14:13:25.918192 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c10e5dd7-2a37-4430-a9a5-b116f4203bcb tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.699910 Jan 11 14:13:25.922253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 33/59] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:25 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:25.928295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 27/60] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:25 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1337 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:25.931472 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-d9816ec5-461d-435d-ae31-c761e453cac6 req-6527ff96-2247-4933-826c-6c0205e2a19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa034417-f545-486a-9795-890931667012", "tag": "5a970ee5-fb4e-433b-a01a-9adab15fef70"}, {"name": "network-changed", "server_uuid": "da33a406-0839-4a04-9800-1444f9ae0b82", "tag": "4d8257f7-0bfc-4ec4-85ba-6f20d746300d"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:25.938997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f30f348d-87a7-4e4b-b613-c98a15e63d8d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:25.945634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:13:25.945634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:13:25.946456 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f30f348d-87a7-4e4b-b613-c98a15e63d8d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:25.953825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-d9816ec5-461d-435d-ae31-c761e453cac6 req-6527ff96-2247-4933-826c-6c0205e2a19f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.954260 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-d9816ec5-461d-435d-ae31-c761e453cac6 req-6527ff96-2247-4933-826c-6c0205e2a19f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.969243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f30f348d-87a7-4e4b-b613-c98a15e63d8d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.970009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f30f348d-87a7-4e4b-b613-c98a15e63d8d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.972147 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f30f348d-87a7-4e4b-b613-c98a15e63d8d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:25.973011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f30f348d-87a7-4e4b-b613-c98a15e63d8d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:25.981655 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-d9816ec5-461d-435d-ae31-c761e453cac6 req-6527ff96-2247-4933-826c-6c0205e2a19f service nova] Creating event network-changed:5a970ee5-fb4e-433b-a01a-9adab15fef70 for instance aa034417-f545-486a-9795-890931667012 on hv-cinder-82413 Jan 11 14:13:25.982417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-d9816ec5-461d-435d-ae31-c761e453cac6 req-6527ff96-2247-4933-826c-6c0205e2a19f service nova] Creating event network-changed:4d8257f7-0bfc-4ec4-85ba-6f20d746300d for instance da33a406-0839-4a04-9800-1444f9ae0b82 on hv-cinder-82413 Jan 11 14:13:25.997087 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-d9816ec5-461d-435d-ae31-c761e453cac6 req-6527ff96-2247-4933-826c-6c0205e2a19f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073107 Jan 11 14:13:26.000564 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 34/61] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:26.398136 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f30f348d-87a7-4e4b-b613-c98a15e63d8d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:26.411676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f30f348d-87a7-4e4b-b613-c98a15e63d8d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.480588 Jan 11 14:13:26.435723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 28/62] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:25 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:26.751144 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a3f83afd-54eb-4d7b-93c9-cf6e4ca692f8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:26.752068 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a3f83afd-54eb-4d7b-93c9-cf6e4ca692f8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:26.769660 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3f83afd-54eb-4d7b-93c9-cf6e4ca692f8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:26.770111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3f83afd-54eb-4d7b-93c9-cf6e4ca692f8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:26.770904 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3f83afd-54eb-4d7b-93c9-cf6e4ca692f8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:26.771523 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3f83afd-54eb-4d7b-93c9-cf6e4ca692f8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:26.934422 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6dfe09a2-08ac-41f9-ae08-b4ca3689437b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:26.935042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6dfe09a2-08ac-41f9-ae08-b4ca3689437b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:26.944040 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6dfe09a2-08ac-41f9-ae08-b4ca3689437b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:26.945821 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6dfe09a2-08ac-41f9-ae08-b4ca3689437b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:26.945821 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6dfe09a2-08ac-41f9-ae08-b4ca3689437b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:26.946143 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6dfe09a2-08ac-41f9-ae08-b4ca3689437b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:27.682774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6dfe09a2-08ac-41f9-ae08-b4ca3689437b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:27.696502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6dfe09a2-08ac-41f9-ae08-b4ca3689437b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.765675 Jan 11 14:13:27.714843 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 29/63] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:26 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:27.725256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:27.728989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:27.738062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:27.738750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:27.739854 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:27.740623 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:27.899036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a3f83afd-54eb-4d7b-93c9-cf6e4ca692f8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:27.924243 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a3f83afd-54eb-4d7b-93c9-cf6e4ca692f8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 1.178524 Jan 11 14:13:27.924876 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 35/64] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:26 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:27.943176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-072ba84f-dc15-4c3e-bddb-569a1814e620 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:27.945562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-072ba84f-dc15-4c3e-bddb-569a1814e620 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:27.971082 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-072ba84f-dc15-4c3e-bddb-569a1814e620 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:27.973891 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-072ba84f-dc15-4c3e-bddb-569a1814e620 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:27.974818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-072ba84f-dc15-4c3e-bddb-569a1814e620 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:27.975280 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-072ba84f-dc15-4c3e-bddb-569a1814e620 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:28.270301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:28.278767 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:28.280381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:28.281522 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3ca9f55b-6c48-45e9-88cc-594d180af9f9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.560709 Jan 11 14:13:28.282099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 30/65] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:27 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:28.404322 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-072ba84f-dc15-4c3e-bddb-569a1814e620 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:28.430640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-072ba84f-dc15-4c3e-bddb-569a1814e620 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.501481 Jan 11 14:13:28.433179 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 36/66] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:27 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:28.715094 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4816e84b-7436-495f-917e-17ee0014b5a2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:28.717145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4816e84b-7436-495f-917e-17ee0014b5a2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:28.729958 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4816e84b-7436-495f-917e-17ee0014b5a2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:28.730643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4816e84b-7436-495f-917e-17ee0014b5a2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:28.731697 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4816e84b-7436-495f-917e-17ee0014b5a2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:28.732485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4816e84b-7436-495f-917e-17ee0014b5a2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:28.940679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e4757fb7-cc32-43c9-b369-7df8910cb7e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:28.941266 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e4757fb7-cc32-43c9-b369-7df8910cb7e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:28.953851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e4757fb7-cc32-43c9-b369-7df8910cb7e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:28.954503 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e4757fb7-cc32-43c9-b369-7df8910cb7e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:28.955449 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e4757fb7-cc32-43c9-b369-7df8910cb7e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:28.956336 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e4757fb7-cc32-43c9-b369-7df8910cb7e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:29.252427 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4816e84b-7436-495f-917e-17ee0014b5a2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:29.273671 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4816e84b-7436-495f-917e-17ee0014b5a2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.562298 Jan 11 14:13:29.282717 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 31/67] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:28 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:29.302708 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:29.307780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:29.323612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:29.324126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:29.324965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:29.325543 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:29.502469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e4757fb7-cc32-43c9-b369-7df8910cb7e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:29.513834 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e4757fb7-cc32-43c9-b369-7df8910cb7e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.575889 Jan 11 14:13:29.516997 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 37/68] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:28 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:29.536894 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-f3a8b025-0173-4ac0-9c26-3495925796cd req-1ff25f8d-9be9-474d-8d42-4f5f8dddff0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07361687-ec7a-4f6e-8e42-530c1a64ba04", "tag": "c51643c6-7fc4-41fe-bb8c-e237ddadcdaf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:29.542801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:13:29.542801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:13:29.559576 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-f3a8b025-0173-4ac0-9c26-3495925796cd req-1ff25f8d-9be9-474d-8d42-4f5f8dddff0e service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:29.561901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-f3a8b025-0173-4ac0-9c26-3495925796cd req-1ff25f8d-9be9-474d-8d42-4f5f8dddff0e service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:29.605718 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-f3a8b025-0173-4ac0-9c26-3495925796cd req-1ff25f8d-9be9-474d-8d42-4f5f8dddff0e service nova] Creating event network-changed:c51643c6-7fc4-41fe-bb8c-e237ddadcdaf for instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 on hv-cinder-82413 Jan 11 14:13:29.621908 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-f3a8b025-0173-4ac0-9c26-3495925796cd req-1ff25f8d-9be9-474d-8d42-4f5f8dddff0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103370 Jan 11 14:13:29.627840 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 38/69] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:29.633409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7a85b6c1-4445-452c-b660-d141a626de79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:29.634307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7a85b6c1-4445-452c-b660-d141a626de79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:29.640811 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a85b6c1-4445-452c-b660-d141a626de79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:29.641469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a85b6c1-4445-452c-b660-d141a626de79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:29.642453 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a85b6c1-4445-452c-b660-d141a626de79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:29.643159 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a85b6c1-4445-452c-b660-d141a626de79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:29.749650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:29.761833 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:29.765914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:29.767354 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5446a569-e02d-4412-afed-687e70d4a26c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.470953 Jan 11 14:13:29.768149 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 32/70] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:29 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:29.934036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7a85b6c1-4445-452c-b660-d141a626de79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:29.941969 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7a85b6c1-4445-452c-b660-d141a626de79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.312585 Jan 11 14:13:29.955243 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 39/71] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:29 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:30.290069 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3971028a-bfac-4546-89d8-73f06211f33e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:30.290741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3971028a-bfac-4546-89d8-73f06211f33e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:30.296906 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3971028a-bfac-4546-89d8-73f06211f33e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:30.297369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3971028a-bfac-4546-89d8-73f06211f33e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:30.298158 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3971028a-bfac-4546-89d8-73f06211f33e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:30.298778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3971028a-bfac-4546-89d8-73f06211f33e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:30.538686 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e04a86ce-98bf-4a00-bfda-c35e7d7404d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:30.539916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e04a86ce-98bf-4a00-bfda-c35e7d7404d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:30.549004 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e04a86ce-98bf-4a00-bfda-c35e7d7404d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:30.550001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e04a86ce-98bf-4a00-bfda-c35e7d7404d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:30.551063 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e04a86ce-98bf-4a00-bfda-c35e7d7404d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:30.551784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e04a86ce-98bf-4a00-bfda-c35e7d7404d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:30.756193 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3971028a-bfac-4546-89d8-73f06211f33e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:30.766685 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3971028a-bfac-4546-89d8-73f06211f33e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.480343 Jan 11 14:13:30.768100 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 33/72] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:30 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:30.788937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:30.789874 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:30.803192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:30.803686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:30.804699 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:30.805155 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:30.862290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e04a86ce-98bf-4a00-bfda-c35e7d7404d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:30.872266 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e04a86ce-98bf-4a00-bfda-c35e7d7404d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.338536 Jan 11 14:13:30.883281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 40/73] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:30 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:30.962076 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-17340fd6-c194-41c1-8a14-905bfc66cd96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:30.962734 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-17340fd6-c194-41c1-8a14-905bfc66cd96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:30.975532 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-17340fd6-c194-41c1-8a14-905bfc66cd96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:30.975997 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-17340fd6-c194-41c1-8a14-905bfc66cd96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:30.982414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-17340fd6-c194-41c1-8a14-905bfc66cd96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:30.982914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-17340fd6-c194-41c1-8a14-905bfc66cd96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:31.092727 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:31.101401 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:31.108715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:31.120903 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-89614daf-1b6e-4cb5-8d9d-10a47973ba27 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.338035 Jan 11 14:13:31.121471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 34/74] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:30 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:31.255868 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-17340fd6-c194-41c1-8a14-905bfc66cd96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:31.263840 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-17340fd6-c194-41c1-8a14-905bfc66cd96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.307710 Jan 11 14:13:31.265319 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 41/75] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:30 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:31.785741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ae08af5c-1d2f-48da-85a6-fa44fa2c8a83 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:31.787622 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ae08af5c-1d2f-48da-85a6-fa44fa2c8a83 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:31.800280 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae08af5c-1d2f-48da-85a6-fa44fa2c8a83 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:31.800966 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae08af5c-1d2f-48da-85a6-fa44fa2c8a83 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:31.804800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae08af5c-1d2f-48da-85a6-fa44fa2c8a83 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:31.805911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae08af5c-1d2f-48da-85a6-fa44fa2c8a83 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:31.890281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-68ff8a60-5b01-433a-9897-46f3518c4b3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:31.890914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-68ff8a60-5b01-433a-9897-46f3518c4b3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:31.902711 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68ff8a60-5b01-433a-9897-46f3518c4b3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:31.903345 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68ff8a60-5b01-433a-9897-46f3518c4b3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:31.906196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68ff8a60-5b01-433a-9897-46f3518c4b3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:31.906817 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68ff8a60-5b01-433a-9897-46f3518c4b3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:32.275823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ae08af5c-1d2f-48da-85a6-fa44fa2c8a83 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:32.289062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ae08af5c-1d2f-48da-85a6-fa44fa2c8a83 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.506521 Jan 11 14:13:32.291526 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 35/76] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:31 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:32.305385 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-68ff8a60-5b01-433a-9897-46f3518c4b3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:32.311309 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:32.317050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-68ff8a60-5b01-433a-9897-46f3518c4b3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.430954 Jan 11 14:13:32.317386 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:32.328339 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 42/77] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:31 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:32.334389 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f93cd929-609e-454b-9aa8-086931441754 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:32.334668 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:32.335328 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:32.335800 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f93cd929-609e-454b-9aa8-086931441754 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:32.336551 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:32.336938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:32.343992 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f93cd929-609e-454b-9aa8-086931441754 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:32.344946 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f93cd929-609e-454b-9aa8-086931441754 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:32.346017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f93cd929-609e-454b-9aa8-086931441754 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:32.346735 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f93cd929-609e-454b-9aa8-086931441754 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:32.591789 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f93cd929-609e-454b-9aa8-086931441754 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:32.605251 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f93cd929-609e-454b-9aa8-086931441754 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.275409 Jan 11 14:13:32.607044 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 43/78] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:32 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:32.638346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:32.649589 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:32.652494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:32.655002 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f490e74f-d43b-4416-a19c-702f096c9e18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.362389 Jan 11 14:13:32.656205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 36/79] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:32 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:33.307576 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-eca5abc5-a8a6-4b1f-92f2-eb4140bc25db tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:33.308430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-eca5abc5-a8a6-4b1f-92f2-eb4140bc25db tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:33.317056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eca5abc5-a8a6-4b1f-92f2-eb4140bc25db tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:33.318931 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eca5abc5-a8a6-4b1f-92f2-eb4140bc25db tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:33.320093 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eca5abc5-a8a6-4b1f-92f2-eb4140bc25db tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:33.322435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eca5abc5-a8a6-4b1f-92f2-eb4140bc25db tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:33.337594 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b0e52857-2854-41d7-9a4e-fab85ab404ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:33.338691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b0e52857-2854-41d7-9a4e-fab85ab404ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:33.347090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b0e52857-2854-41d7-9a4e-fab85ab404ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:33.347753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b0e52857-2854-41d7-9a4e-fab85ab404ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:33.349164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b0e52857-2854-41d7-9a4e-fab85ab404ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:33.350981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b0e52857-2854-41d7-9a4e-fab85ab404ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:33.562595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-eca5abc5-a8a6-4b1f-92f2-eb4140bc25db tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:33.570056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b0e52857-2854-41d7-9a4e-fab85ab404ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:33.581444 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-eca5abc5-a8a6-4b1f-92f2-eb4140bc25db tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.276133 Jan 11 14:13:33.581444 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 44/80] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:33 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:33.582656 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b0e52857-2854-41d7-9a4e-fab85ab404ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.252109 Jan 11 14:13:33.583341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 37/81] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:33 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:33.624655 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a31f934a-f262-4b84-80b2-e46d32ef3faf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:33.625282 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a31f934a-f262-4b84-80b2-e46d32ef3faf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:33.632060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a31f934a-f262-4b84-80b2-e46d32ef3faf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:33.632523 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a31f934a-f262-4b84-80b2-e46d32ef3faf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:33.633299 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a31f934a-f262-4b84-80b2-e46d32ef3faf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:33.633729 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a31f934a-f262-4b84-80b2-e46d32ef3faf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:33.673418 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:33.680402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:33.690124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:33.694612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:33.695576 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:33.696183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:33.842184 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a31f934a-f262-4b84-80b2-e46d32ef3faf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:33.850741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a31f934a-f262-4b84-80b2-e46d32ef3faf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.230968 Jan 11 14:13:33.851446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 45/82] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:33 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:33.906320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:33.916537 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:33.918282 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:33.919686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3ca9ca88-81a4-467c-8a60-59c41d47db39 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.250497 Jan 11 14:13:33.920409 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 38/83] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:33 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:34.596953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8d86d5de-3331-4f39-a124-b846b5db0ff2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:34.597577 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8d86d5de-3331-4f39-a124-b846b5db0ff2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:34.598465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-25674b87-724d-458a-87ff-24e99367508e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:34.599153 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-25674b87-724d-458a-87ff-24e99367508e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:34.603414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d86d5de-3331-4f39-a124-b846b5db0ff2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:34.603897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d86d5de-3331-4f39-a124-b846b5db0ff2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:34.604853 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d86d5de-3331-4f39-a124-b846b5db0ff2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:34.605316 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-25674b87-724d-458a-87ff-24e99367508e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:34.605533 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d86d5de-3331-4f39-a124-b846b5db0ff2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:34.605771 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-25674b87-724d-458a-87ff-24e99367508e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:34.606583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-25674b87-724d-458a-87ff-24e99367508e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:34.607540 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-25674b87-724d-458a-87ff-24e99367508e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:34.801366 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-25674b87-724d-458a-87ff-24e99367508e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:34.808510 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-25674b87-724d-458a-87ff-24e99367508e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.213875 Jan 11 14:13:34.808629 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8d86d5de-3331-4f39-a124-b846b5db0ff2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:34.809012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 39/84] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:34 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:34.816365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8d86d5de-3331-4f39-a124-b846b5db0ff2 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.223022 Jan 11 14:13:34.817688 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 46/85] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:34 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:34.867550 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c87c8fc8-eb83-4b20-9bbf-dd04d922d64f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:34.868155 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c87c8fc8-eb83-4b20-9bbf-dd04d922d64f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:34.875697 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c87c8fc8-eb83-4b20-9bbf-dd04d922d64f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:34.876334 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c87c8fc8-eb83-4b20-9bbf-dd04d922d64f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:34.877440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c87c8fc8-eb83-4b20-9bbf-dd04d922d64f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:34.878066 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c87c8fc8-eb83-4b20-9bbf-dd04d922d64f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:34.937682 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:34.938650 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:34.944494 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:34.944956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:34.945763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:34.946197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:35.052378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c87c8fc8-eb83-4b20-9bbf-dd04d922d64f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:35.060344 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c87c8fc8-eb83-4b20-9bbf-dd04d922d64f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.196313 Jan 11 14:13:35.060846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 40/86] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:34 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:35.115630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:35.123883 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:35.125568 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:35.126643 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4b312ec3-9d60-45cf-9416-c97fbbc9be7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.193449 Jan 11 14:13:35.127190 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 47/87] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:34 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:35.825666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d98c1598-a779-4149-8296-e62d7f199e89 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:35.826250 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d98c1598-a779-4149-8296-e62d7f199e89 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:35.832299 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d98c1598-a779-4149-8296-e62d7f199e89 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:35.832750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d98c1598-a779-4149-8296-e62d7f199e89 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:35.833534 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d98c1598-a779-4149-8296-e62d7f199e89 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:35.833965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d98c1598-a779-4149-8296-e62d7f199e89 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:35.835144 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-963e884e-b756-4014-b2af-4ded014a929c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:35.835781 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-963e884e-b756-4014-b2af-4ded014a929c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:35.841658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-963e884e-b756-4014-b2af-4ded014a929c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:35.842107 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-963e884e-b756-4014-b2af-4ded014a929c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:35.842889 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-963e884e-b756-4014-b2af-4ded014a929c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:35.843331 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-963e884e-b756-4014-b2af-4ded014a929c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:36.020232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d98c1598-a779-4149-8296-e62d7f199e89 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:36.027410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d98c1598-a779-4149-8296-e62d7f199e89 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.205759 Jan 11 14:13:36.028203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 41/88] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:35 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:36.031067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-963e884e-b756-4014-b2af-4ded014a929c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:36.038270 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-963e884e-b756-4014-b2af-4ded014a929c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.206777 Jan 11 14:13:36.038851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 48/89] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:35 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:36.076786 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7ef8bea0-32ef-4ffd-a4b8-8e23f26bdd18 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:36.077335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7ef8bea0-32ef-4ffd-a4b8-8e23f26bdd18 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:36.083000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ef8bea0-32ef-4ffd-a4b8-8e23f26bdd18 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:36.083452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ef8bea0-32ef-4ffd-a4b8-8e23f26bdd18 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:36.084259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ef8bea0-32ef-4ffd-a4b8-8e23f26bdd18 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:36.084694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ef8bea0-32ef-4ffd-a4b8-8e23f26bdd18 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:36.144402 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:36.145011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:36.150763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:36.151209 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:36.152013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:36.152451 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:36.246245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7ef8bea0-32ef-4ffd-a4b8-8e23f26bdd18 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:36.253568 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7ef8bea0-32ef-4ffd-a4b8-8e23f26bdd18 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.180573 Jan 11 14:13:36.254141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 42/90] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:36 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:36.313492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:36.321990 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:36.323839 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:36.324907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fb9c47ca-37e3-45a0-a39e-8b75f517bc65 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.184213 Jan 11 14:13:36.325461 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 49/91] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:36 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:37.043691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6c8d3704-97af-4580-a41f-2a12da92b1e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:37.044305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6c8d3704-97af-4580-a41f-2a12da92b1e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:37.050283 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6c8d3704-97af-4580-a41f-2a12da92b1e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:37.050727 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6c8d3704-97af-4580-a41f-2a12da92b1e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:37.051518 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6c8d3704-97af-4580-a41f-2a12da92b1e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:37.051968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6c8d3704-97af-4580-a41f-2a12da92b1e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:37.053715 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6dad8253-16dc-4ee3-a62d-6e0de1b7876e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:37.054307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6dad8253-16dc-4ee3-a62d-6e0de1b7876e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:37.060608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6dad8253-16dc-4ee3-a62d-6e0de1b7876e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:37.061054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6dad8253-16dc-4ee3-a62d-6e0de1b7876e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:37.061835 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6dad8253-16dc-4ee3-a62d-6e0de1b7876e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:37.062269 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6dad8253-16dc-4ee3-a62d-6e0de1b7876e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:37.243252 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6c8d3704-97af-4580-a41f-2a12da92b1e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:37.248810 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6dad8253-16dc-4ee3-a62d-6e0de1b7876e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:37.251467 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6c8d3704-97af-4580-a41f-2a12da92b1e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.211393 Jan 11 14:13:37.252063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 43/92] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:37 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:37.256618 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6dad8253-16dc-4ee3-a62d-6e0de1b7876e tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.206421 Jan 11 14:13:37.257313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 50/93] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:37 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:37.270378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ef23660e-d08d-48fe-b21a-0cb6ff762b17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:37.270990 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ef23660e-d08d-48fe-b21a-0cb6ff762b17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:37.276903 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ef23660e-d08d-48fe-b21a-0cb6ff762b17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:37.277382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ef23660e-d08d-48fe-b21a-0cb6ff762b17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:37.278163 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ef23660e-d08d-48fe-b21a-0cb6ff762b17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:37.278604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ef23660e-d08d-48fe-b21a-0cb6ff762b17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:37.342500 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:37.343631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:37.349583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:37.350329 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:37.351474 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:37.352398 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:37.437067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ef23660e-d08d-48fe-b21a-0cb6ff762b17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:37.445804 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ef23660e-d08d-48fe-b21a-0cb6ff762b17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.178959 Jan 11 14:13:37.446492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 44/94] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:37 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:37.505030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:37.512734 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:37.514776 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:37.515901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e8b8071e-d5fa-4b58-8239-696c7c7f2151 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.177444 Jan 11 14:13:37.516450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 51/95] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:37 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:38.267694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ac92b59e-d3c3-4d02-8a41-67c962743ea9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:38.268224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ac92b59e-d3c3-4d02-8a41-67c962743ea9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:38.273205 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f39f4dcc-52b5-452a-8958-b5af7b43f020 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:38.273823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f39f4dcc-52b5-452a-8958-b5af7b43f020 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:38.273950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac92b59e-d3c3-4d02-8a41-67c962743ea9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:38.274403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac92b59e-d3c3-4d02-8a41-67c962743ea9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:38.275180 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac92b59e-d3c3-4d02-8a41-67c962743ea9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:38.275649 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac92b59e-d3c3-4d02-8a41-67c962743ea9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:38.279702 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f39f4dcc-52b5-452a-8958-b5af7b43f020 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:38.280157 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f39f4dcc-52b5-452a-8958-b5af7b43f020 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:38.280939 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f39f4dcc-52b5-452a-8958-b5af7b43f020 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:38.281378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f39f4dcc-52b5-452a-8958-b5af7b43f020 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:38.461916 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ac92b59e-d3c3-4d02-8a41-67c962743ea9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:38.469397 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f39f4dcc-52b5-452a-8958-b5af7b43f020 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:38.469656 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ac92b59e-d3c3-4d02-8a41-67c962743ea9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.205711 Jan 11 14:13:38.470230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 45/96] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:38 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:38.474412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-99c52748-ea20-4b4f-86b2-0a3754c01b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:38.475009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-99c52748-ea20-4b4f-86b2-0a3754c01b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:38.476988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f39f4dcc-52b5-452a-8958-b5af7b43f020 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.207230 Jan 11 14:13:38.478386 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 52/97] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:38 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:38.480879 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-99c52748-ea20-4b4f-86b2-0a3754c01b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:38.481325 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-99c52748-ea20-4b4f-86b2-0a3754c01b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:38.482910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-99c52748-ea20-4b4f-86b2-0a3754c01b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:38.483352 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-99c52748-ea20-4b4f-86b2-0a3754c01b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:38.534018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:38.534542 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:38.540396 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:38.541022 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:38.541818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:38.542254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:38.644090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-99c52748-ea20-4b4f-86b2-0a3754c01b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:38.651534 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-99c52748-ea20-4b4f-86b2-0a3754c01b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.180338 Jan 11 14:13:38.652106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 46/98] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:38 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:38.700041 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:38.709831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:38.711360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:38.712490 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c7c43263-b7be-4aa1-948b-571bd01f7a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.182275 Jan 11 14:13:38.713043 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 53/99] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:38 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:39.486115 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-62055e1c-f391-4d74-8767-91f026082fe3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:39.486719 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-62055e1c-f391-4d74-8767-91f026082fe3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:39.492586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62055e1c-f391-4d74-8767-91f026082fe3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:39.493031 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62055e1c-f391-4d74-8767-91f026082fe3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:39.493571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ea255283-e67f-4e28-9d1e-be5586a95d94 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:39.493964 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62055e1c-f391-4d74-8767-91f026082fe3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:39.494186 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ea255283-e67f-4e28-9d1e-be5586a95d94 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:39.494277 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-62055e1c-f391-4d74-8767-91f026082fe3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:39.500446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ea255283-e67f-4e28-9d1e-be5586a95d94 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:39.500900 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ea255283-e67f-4e28-9d1e-be5586a95d94 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:39.501671 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ea255283-e67f-4e28-9d1e-be5586a95d94 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:39.502103 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ea255283-e67f-4e28-9d1e-be5586a95d94 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:39.680152 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-62055e1c-f391-4d74-8767-91f026082fe3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:39.688289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-62055e1c-f391-4d74-8767-91f026082fe3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.206240 Jan 11 14:13:39.696251 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 47/100] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:39 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:39.696523 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ea255283-e67f-4e28-9d1e-be5586a95d94 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:39.701261 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1f6e09a0-95b1-434a-9bdb-03b2048dab8c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:39.701394 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ea255283-e67f-4e28-9d1e-be5586a95d94 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.211354 Jan 11 14:13:39.701957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 54/101] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:39 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:39.702094 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1f6e09a0-95b1-434a-9bdb-03b2048dab8c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:39.708577 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1f6e09a0-95b1-434a-9bdb-03b2048dab8c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:39.709032 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1f6e09a0-95b1-434a-9bdb-03b2048dab8c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:39.709828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1f6e09a0-95b1-434a-9bdb-03b2048dab8c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:39.710269 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1f6e09a0-95b1-434a-9bdb-03b2048dab8c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:39.729949 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:39.730548 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:39.736768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:39.737214 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:39.737979 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:39.738405 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:39.892555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1f6e09a0-95b1-434a-9bdb-03b2048dab8c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:39.899651 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1f6e09a0-95b1-434a-9bdb-03b2048dab8c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.209486 Jan 11 14:13:39.900439 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 48/102] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:39 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:39.916274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:39.925135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:39.926810 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:39.927952 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b8f063cb-a169-4242-8770-0eda5275b4fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.201660 Jan 11 14:13:39.928518 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 55/103] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:39 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:40.704760 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f63d121d-5e5a-4e2f-9fe4-e53fdc3bcb2a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:40.705405 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f63d121d-5e5a-4e2f-9fe4-e53fdc3bcb2a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:40.711249 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f63d121d-5e5a-4e2f-9fe4-e53fdc3bcb2a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:40.711938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f63d121d-5e5a-4e2f-9fe4-e53fdc3bcb2a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:40.713054 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f63d121d-5e5a-4e2f-9fe4-e53fdc3bcb2a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:40.713679 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f63d121d-5e5a-4e2f-9fe4-e53fdc3bcb2a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:40.717704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b1264faa-67f6-471c-9d9c-b2c41137fe63 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:40.718337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b1264faa-67f6-471c-9d9c-b2c41137fe63 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:40.724067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b1264faa-67f6-471c-9d9c-b2c41137fe63 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:40.724517 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b1264faa-67f6-471c-9d9c-b2c41137fe63 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:40.725292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b1264faa-67f6-471c-9d9c-b2c41137fe63 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:40.725725 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b1264faa-67f6-471c-9d9c-b2c41137fe63 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:40.916095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f63d121d-5e5a-4e2f-9fe4-e53fdc3bcb2a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:40.923222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b1264faa-67f6-471c-9d9c-b2c41137fe63 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:40.923432 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f63d121d-5e5a-4e2f-9fe4-e53fdc3bcb2a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.222963 Jan 11 14:13:40.924045 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 49/104] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:40 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:40.928268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-34ef6947-ec27-4060-9026-a2edc38a5320 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:40.928873 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-34ef6947-ec27-4060-9026-a2edc38a5320 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:40.931338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b1264faa-67f6-471c-9d9c-b2c41137fe63 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.217206 Jan 11 14:13:40.931970 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 56/105] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:40 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:40.934763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34ef6947-ec27-4060-9026-a2edc38a5320 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:40.935745 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34ef6947-ec27-4060-9026-a2edc38a5320 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:40.936591 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34ef6947-ec27-4060-9026-a2edc38a5320 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:40.937038 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34ef6947-ec27-4060-9026-a2edc38a5320 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:40.945739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:40.946348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:40.952967 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:40.953418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:40.954206 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:40.954641 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:41.130952 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-34ef6947-ec27-4060-9026-a2edc38a5320 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:41.135348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:41.138255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-34ef6947-ec27-4060-9026-a2edc38a5320 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.213265 Jan 11 14:13:41.138822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 50/106] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:40 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:41.143122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:41.144664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:41.145755 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9083a19b-063d-41b5-8f3b-892442749b5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.203623 Jan 11 14:13:41.146296 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 57/107] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:40 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:41.939389 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f296dfb6-81cf-4544-b710-5a194eb0028f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:41.940035 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f296dfb6-81cf-4544-b710-5a194eb0028f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:41.946396 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f296dfb6-81cf-4544-b710-5a194eb0028f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:41.946841 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f296dfb6-81cf-4544-b710-5a194eb0028f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:41.947651 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f296dfb6-81cf-4544-b710-5a194eb0028f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:41.948343 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f296dfb6-81cf-4544-b710-5a194eb0028f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:41.948659 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-34930ac6-351d-4145-bc71-6419e840ba37 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:41.949266 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-34930ac6-351d-4145-bc71-6419e840ba37 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:41.957352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34930ac6-351d-4145-bc71-6419e840ba37 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:41.957821 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34930ac6-351d-4145-bc71-6419e840ba37 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:41.958745 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34930ac6-351d-4145-bc71-6419e840ba37 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:41.959179 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34930ac6-351d-4145-bc71-6419e840ba37 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:42.157663 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f296dfb6-81cf-4544-b710-5a194eb0028f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:42.163029 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-34930ac6-351d-4145-bc71-6419e840ba37 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:42.166841 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f296dfb6-81cf-4544-b710-5a194eb0028f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.231603 Jan 11 14:13:42.167721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 51/108] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:41 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:42.172500 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-34930ac6-351d-4145-bc71-6419e840ba37 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.227720 Jan 11 14:13:42.172824 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b70508af-9f3f-40e4-bdcd-723c01756b71 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:42.181538 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 58/109] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:41 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:42.181703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b70508af-9f3f-40e4-bdcd-723c01756b71 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:42.181788 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:42.181788 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:42.181911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b70508af-9f3f-40e4-bdcd-723c01756b71 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:42.181911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b70508af-9f3f-40e4-bdcd-723c01756b71 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:42.181911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b70508af-9f3f-40e4-bdcd-723c01756b71 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:42.181911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b70508af-9f3f-40e4-bdcd-723c01756b71 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:42.185822 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:42.186275 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:42.187057 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:42.187502 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:42.371343 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b70508af-9f3f-40e4-bdcd-723c01756b71 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:42.379082 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:42.379289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b70508af-9f3f-40e4-bdcd-723c01756b71 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.210564 Jan 11 14:13:42.379917 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 52/110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:42 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:42.387022 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:42.389131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:42.390219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f0f228cc-f4d1-49c2-8a4b-0c3ae93383be tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.215998 Jan 11 14:13:42.390767 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 59/111] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:42 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:43.183447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3aa23d8c-569d-47ab-9493-0c8f6c94b46a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:43.184178 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3aa23d8c-569d-47ab-9493-0c8f6c94b46a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:43.188726 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8da7da85-8d64-41b9-a4de-2faeb391c4ae tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:43.189478 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8da7da85-8d64-41b9-a4de-2faeb391c4ae tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:43.190038 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aa23d8c-569d-47ab-9493-0c8f6c94b46a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:43.190490 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aa23d8c-569d-47ab-9493-0c8f6c94b46a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:43.191278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aa23d8c-569d-47ab-9493-0c8f6c94b46a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:43.191966 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aa23d8c-569d-47ab-9493-0c8f6c94b46a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:43.195223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8da7da85-8d64-41b9-a4de-2faeb391c4ae tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:43.195716 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8da7da85-8d64-41b9-a4de-2faeb391c4ae tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:43.196529 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8da7da85-8d64-41b9-a4de-2faeb391c4ae tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:43.197003 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8da7da85-8d64-41b9-a4de-2faeb391c4ae tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:43.380920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3aa23d8c-569d-47ab-9493-0c8f6c94b46a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:43.384015 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8da7da85-8d64-41b9-a4de-2faeb391c4ae tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:43.388828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3aa23d8c-569d-47ab-9493-0c8f6c94b46a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.208523 Jan 11 14:13:43.389390 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 53/112] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:43 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:43.391919 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8da7da85-8d64-41b9-a4de-2faeb391c4ae tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.206708 Jan 11 14:13:43.392482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 60/113] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:43 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:43.400338 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-705c4eb0-e418-41d7-9945-4b3cc4e3db72 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:43.401046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-705c4eb0-e418-41d7-9945-4b3cc4e3db72 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:43.407338 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-705c4eb0-e418-41d7-9945-4b3cc4e3db72 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:43.407818 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-705c4eb0-e418-41d7-9945-4b3cc4e3db72 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:43.408354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:43.408591 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-705c4eb0-e418-41d7-9945-4b3cc4e3db72 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:43.408956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:43.409043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-705c4eb0-e418-41d7-9945-4b3cc4e3db72 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:43.414757 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:43.415207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:43.416031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:43.416496 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:43.762928 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-705c4eb0-e418-41d7-9945-4b3cc4e3db72 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:43.767400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:43.770345 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-705c4eb0-e418-41d7-9945-4b3cc4e3db72 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.373572 Jan 11 14:13:43.770918 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 54/114] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:43 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:43.775690 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:43.777234 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:43.778343 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f2763500-dea0-4ea7-a668-b4deac388abd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.373549 Jan 11 14:13:43.779414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 61/115] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:43 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:44.405919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-81330721-88ae-4792-a617-19a8f52725a2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:44.406527 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-81330721-88ae-4792-a617-19a8f52725a2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:44.408381 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3e74113d-a660-4839-94cc-5e1e17f7b594 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:44.408985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3e74113d-a660-4839-94cc-5e1e17f7b594 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:44.412411 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-81330721-88ae-4792-a617-19a8f52725a2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:44.412862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-81330721-88ae-4792-a617-19a8f52725a2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:44.413645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-81330721-88ae-4792-a617-19a8f52725a2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:44.414097 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-81330721-88ae-4792-a617-19a8f52725a2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:44.414567 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3e74113d-a660-4839-94cc-5e1e17f7b594 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:44.415013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3e74113d-a660-4839-94cc-5e1e17f7b594 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:44.415808 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3e74113d-a660-4839-94cc-5e1e17f7b594 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:44.416235 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3e74113d-a660-4839-94cc-5e1e17f7b594 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:44.604094 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-81330721-88ae-4792-a617-19a8f52725a2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:44.608038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3e74113d-a660-4839-94cc-5e1e17f7b594 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:44.612206 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-81330721-88ae-4792-a617-19a8f52725a2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.210630 Jan 11 14:13:44.612871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 55/116] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:44 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:44.616050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3e74113d-a660-4839-94cc-5e1e17f7b594 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.211225 Jan 11 14:13:44.616606 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 62/117] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:44 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:44.788292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d63b5ba3-d484-4472-a276-89a253361b41 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:44.788845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d63b5ba3-d484-4472-a276-89a253361b41 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:44.794740 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d63b5ba3-d484-4472-a276-89a253361b41 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:44.795187 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d63b5ba3-d484-4472-a276-89a253361b41 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:44.795989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d63b5ba3-d484-4472-a276-89a253361b41 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:44.796109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:44.796424 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d63b5ba3-d484-4472-a276-89a253361b41 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:44.796696 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:44.802494 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:44.802939 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:44.803732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:44.804162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:44.980891 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d63b5ba3-d484-4472-a276-89a253361b41 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:44.987986 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:44.988114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d63b5ba3-d484-4472-a276-89a253361b41 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.203476 Jan 11 14:13:44.988588 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 56/118] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:44 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:44.996233 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:44.997864 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:44.999015 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cb704eae-71c8-4de9-bc9b-9fa25f4be4b3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.206605 Jan 11 14:13:44.999594 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 63/119] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:44 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:45.628232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5074caa0-e099-4989-ad9a-be62495b1fa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:45.628830 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5074caa0-e099-4989-ad9a-be62495b1fa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:45.631967 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d51c67fe-2c07-4e55-ba54-7df2bb523123 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:45.632601 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d51c67fe-2c07-4e55-ba54-7df2bb523123 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:45.634650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5074caa0-e099-4989-ad9a-be62495b1fa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:45.635103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5074caa0-e099-4989-ad9a-be62495b1fa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:45.635922 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5074caa0-e099-4989-ad9a-be62495b1fa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:45.636377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5074caa0-e099-4989-ad9a-be62495b1fa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:45.638527 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d51c67fe-2c07-4e55-ba54-7df2bb523123 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:45.639033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d51c67fe-2c07-4e55-ba54-7df2bb523123 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:45.639849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d51c67fe-2c07-4e55-ba54-7df2bb523123 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:45.640278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d51c67fe-2c07-4e55-ba54-7df2bb523123 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:45.826456 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5074caa0-e099-4989-ad9a-be62495b1fa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:45.829598 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d51c67fe-2c07-4e55-ba54-7df2bb523123 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:45.833701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5074caa0-e099-4989-ad9a-be62495b1fa5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.209089 Jan 11 14:13:45.834432 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 57/120] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:45 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:45.836988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d51c67fe-2c07-4e55-ba54-7df2bb523123 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.208508 Jan 11 14:13:45.837486 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 64/121] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:45 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:46.004484 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1a778c8c-7366-4325-b61b-83b52cd770d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:46.005085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1a778c8c-7366-4325-b61b-83b52cd770d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:46.010805 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1a778c8c-7366-4325-b61b-83b52cd770d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:46.011248 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1a778c8c-7366-4325-b61b-83b52cd770d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:46.012042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1a778c8c-7366-4325-b61b-83b52cd770d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:46.012474 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1a778c8c-7366-4325-b61b-83b52cd770d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:46.017123 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:46.017814 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:46.023447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:46.023926 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:46.024702 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:46.025131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:46.208299 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1a778c8c-7366-4325-b61b-83b52cd770d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:46.212485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:46.215730 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1a778c8c-7366-4325-b61b-83b52cd770d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.214829 Jan 11 14:13:46.216301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 58/122] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:45 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:46.220392 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:46.221913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:46.222998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-be579d0b-0c1f-4e3d-94b1-fbffeecfae47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.210182 Jan 11 14:13:46.223719 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 65/123] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:46 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:46.850737 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0d545655-f494-4bd7-8458-1f812ecd3e1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:46.851346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0d545655-f494-4bd7-8458-1f812ecd3e1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:46.853150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5e411ecd-6c08-41af-8ada-83c65d78d6c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:46.853795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5e411ecd-6c08-41af-8ada-83c65d78d6c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:46.857381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d545655-f494-4bd7-8458-1f812ecd3e1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:46.857838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d545655-f494-4bd7-8458-1f812ecd3e1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:46.858627 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d545655-f494-4bd7-8458-1f812ecd3e1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:46.859059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d545655-f494-4bd7-8458-1f812ecd3e1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:46.859777 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e411ecd-6c08-41af-8ada-83c65d78d6c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:46.860272 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e411ecd-6c08-41af-8ada-83c65d78d6c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:46.861620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e411ecd-6c08-41af-8ada-83c65d78d6c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:46.862202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e411ecd-6c08-41af-8ada-83c65d78d6c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:47.049780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0d545655-f494-4bd7-8458-1f812ecd3e1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:47.056710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5e411ecd-6c08-41af-8ada-83c65d78d6c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:47.056990 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0d545655-f494-4bd7-8458-1f812ecd3e1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.210185 Jan 11 14:13:47.057554 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 59/124] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:46 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:47.064287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5e411ecd-6c08-41af-8ada-83c65d78d6c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.214876 Jan 11 14:13:47.064920 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 66/125] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:46 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:47.232672 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4753824b-ff43-48d8-a360-9bbd6c3e142f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:47.233202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4753824b-ff43-48d8-a360-9bbd6c3e142f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:47.239007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4753824b-ff43-48d8-a360-9bbd6c3e142f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:47.239452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4753824b-ff43-48d8-a360-9bbd6c3e142f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:47.239600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:47.240134 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:47.240257 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4753824b-ff43-48d8-a360-9bbd6c3e142f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:47.240689 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4753824b-ff43-48d8-a360-9bbd6c3e142f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:47.245776 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:47.246222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:47.246980 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:47.248008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:47.435232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:47.438703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4753824b-ff43-48d8-a360-9bbd6c3e142f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:47.443142 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:47.444675 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:47.445794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e8e3d8bd-a7a2-4823-86f7-ae2fd236bb9e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.209808 Jan 11 14:13:47.445896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4753824b-ff43-48d8-a360-9bbd6c3e142f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.217412 Jan 11 14:13:47.446418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 67/126] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:47 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:47.447268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 60/127] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:47 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:48.073260 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-97743c6c-86e0-4114-931f-8d3095bb1a32 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:48.073783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-97743c6c-86e0-4114-931f-8d3095bb1a32 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:48.079754 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97743c6c-86e0-4114-931f-8d3095bb1a32 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:48.080199 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97743c6c-86e0-4114-931f-8d3095bb1a32 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:48.080796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-246d9a84-6962-49ab-89d8-6c6a074dcad0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:48.081176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97743c6c-86e0-4114-931f-8d3095bb1a32 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:48.081427 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97743c6c-86e0-4114-931f-8d3095bb1a32 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:48.081529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-246d9a84-6962-49ab-89d8-6c6a074dcad0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:48.086978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-246d9a84-6962-49ab-89d8-6c6a074dcad0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:48.087415 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-246d9a84-6962-49ab-89d8-6c6a074dcad0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:48.088286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-246d9a84-6962-49ab-89d8-6c6a074dcad0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:48.088711 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-246d9a84-6962-49ab-89d8-6c6a074dcad0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:48.287888 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-97743c6c-86e0-4114-931f-8d3095bb1a32 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:48.291075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-246d9a84-6962-49ab-89d8-6c6a074dcad0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:48.295942 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-97743c6c-86e0-4114-931f-8d3095bb1a32 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.226668 Jan 11 14:13:48.297155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 68/128] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:48 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:48.305111 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-246d9a84-6962-49ab-89d8-6c6a074dcad0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.227762 Jan 11 14:13:48.305774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 61/129] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:48 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:48.469254 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:48.470032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-dc828438-a392-4cf8-bb04-4309764ba8ec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:48.470825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-dc828438-a392-4cf8-bb04-4309764ba8ec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:48.473016 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:48.482269 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:48.482723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:48.484649 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dc828438-a392-4cf8-bb04-4309764ba8ec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:48.485257 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dc828438-a392-4cf8-bb04-4309764ba8ec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:48.486771 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dc828438-a392-4cf8-bb04-4309764ba8ec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:48.487341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:48.487989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:48.488570 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dc828438-a392-4cf8-bb04-4309764ba8ec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:48.697328 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-dc828438-a392-4cf8-bb04-4309764ba8ec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:48.706597 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-dc828438-a392-4cf8-bb04-4309764ba8ec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.246027 Jan 11 14:13:48.707170 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 69/130] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:48 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:48.716645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:48.719196 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:48.722412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:48.723780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-28be78b2-d137-4745-b9fd-d0223aeef707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.262997 Jan 11 14:13:48.724525 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 62/131] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:48 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:49.173197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-b8d2415f-7662-4bae-b126-4fea819405d8 req-347492c0-0221-4701-90cb-9b987e05df7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667829c5-ceaa-492a-8a6f-98dfd8155a4c", "name": "network-vif-plugged", "status": "completed", "tag": "c063d65b-930d-449b-91e5-7f64c92f6387"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:49.174879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:13:49.174879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:13:49.187148 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b8d2415f-7662-4bae-b126-4fea819405d8 req-347492c0-0221-4701-90cb-9b987e05df7f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.187618 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b8d2415f-7662-4bae-b126-4fea819405d8 req-347492c0-0221-4701-90cb-9b987e05df7f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.205325 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-b8d2415f-7662-4bae-b126-4fea819405d8 req-347492c0-0221-4701-90cb-9b987e05df7f service nova] Creating event network-vif-plugged:c063d65b-930d-449b-91e5-7f64c92f6387 for instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c on hv-cinder-82413 Jan 11 14:13:49.212869 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-b8d2415f-7662-4bae-b126-4fea819405d8 req-347492c0-0221-4701-90cb-9b987e05df7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108396 Jan 11 14:13:49.214131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 70/132] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:49.314182 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-98c31dfa-a4d8-43de-831f-2351f1994050 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:49.315967 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-98c31dfa-a4d8-43de-831f-2351f1994050 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:49.325776 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5ba8ba86-e171-4ab9-acdf-95e5bec2625c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:49.326640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5ba8ba86-e171-4ab9-acdf-95e5bec2625c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:49.339010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-98c31dfa-a4d8-43de-831f-2351f1994050 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.339722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-98c31dfa-a4d8-43de-831f-2351f1994050 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.339871 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5ba8ba86-e171-4ab9-acdf-95e5bec2625c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.340462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5ba8ba86-e171-4ab9-acdf-95e5bec2625c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.341601 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-98c31dfa-a4d8-43de-831f-2351f1994050 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.342049 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-98c31dfa-a4d8-43de-831f-2351f1994050 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.345261 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5ba8ba86-e171-4ab9-acdf-95e5bec2625c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.345733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5ba8ba86-e171-4ab9-acdf-95e5bec2625c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.628963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5ba8ba86-e171-4ab9-acdf-95e5bec2625c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:49.645511 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5ba8ba86-e171-4ab9-acdf-95e5bec2625c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.321069 Jan 11 14:13:49.647096 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 71/133] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:49 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:49.657343 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-98c31dfa-a4d8-43de-831f-2351f1994050 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:49.666352 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-98c31dfa-a4d8-43de-831f-2351f1994050 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.356639 Jan 11 14:13:49.667542 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 63/134] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:49 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:49.723229 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0e7abb6d-7b10-449f-b52c-66b666a8f528 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:49.723871 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0e7abb6d-7b10-449f-b52c-66b666a8f528 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:49.729567 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0e7abb6d-7b10-449f-b52c-66b666a8f528 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.730242 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0e7abb6d-7b10-449f-b52c-66b666a8f528 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.731026 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0e7abb6d-7b10-449f-b52c-66b666a8f528 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.731508 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0e7abb6d-7b10-449f-b52c-66b666a8f528 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.745381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:49.746050 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:49.754320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.754797 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.755814 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:49.756246 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:49.953656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0e7abb6d-7b10-449f-b52c-66b666a8f528 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:49.962756 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0e7abb6d-7b10-449f-b52c-66b666a8f528 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.243192 Jan 11 14:13:49.963365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 72/135] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:49 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:49.964190 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:49.973289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:49.974899 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:49.976303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f4dfde7b-4b2e-4df4-ab78-66a1273bf0ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.238057 Jan 11 14:13:49.977359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 64/136] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:49 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:50.662839 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9491b565-21c3-46df-a404-9f2bdb12e8f1 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:50.663550 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9491b565-21c3-46df-a404-9f2bdb12e8f1 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:50.669375 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9491b565-21c3-46df-a404-9f2bdb12e8f1 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:50.669822 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9491b565-21c3-46df-a404-9f2bdb12e8f1 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:50.670595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9491b565-21c3-46df-a404-9f2bdb12e8f1 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:50.671025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9491b565-21c3-46df-a404-9f2bdb12e8f1 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:50.682923 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-44cc3b19-6ed4-4939-976c-3c1c07a45a03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:50.683603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-44cc3b19-6ed4-4939-976c-3c1c07a45a03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:50.693766 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44cc3b19-6ed4-4939-976c-3c1c07a45a03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:50.694209 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44cc3b19-6ed4-4939-976c-3c1c07a45a03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:50.695046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44cc3b19-6ed4-4939-976c-3c1c07a45a03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:50.695479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44cc3b19-6ed4-4939-976c-3c1c07a45a03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:50.882674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9491b565-21c3-46df-a404-9f2bdb12e8f1 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:50.885728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-44cc3b19-6ed4-4939-976c-3c1c07a45a03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:50.894272 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-44cc3b19-6ed4-4939-976c-3c1c07a45a03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.214967 Jan 11 14:13:50.895414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 65/137] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:50 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:50.897937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9491b565-21c3-46df-a404-9f2bdb12e8f1 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.238485 Jan 11 14:13:50.898717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 73/138] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:50 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:50.980841 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-312a3eca-df59-4a05-ab1f-254ab4b57a48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:50.981590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-312a3eca-df59-4a05-ab1f-254ab4b57a48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:50.987908 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-312a3eca-df59-4a05-ab1f-254ab4b57a48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:50.988351 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-312a3eca-df59-4a05-ab1f-254ab4b57a48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:50.989402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-312a3eca-df59-4a05-ab1f-254ab4b57a48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:50.989828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-312a3eca-df59-4a05-ab1f-254ab4b57a48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:50.993998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:50.994605 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:51.000536 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:51.000988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:51.001766 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:51.002195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:51.188839 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:51.192414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-312a3eca-df59-4a05-ab1f-254ab4b57a48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:51.197045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:51.198823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:51.199948 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9fd9c790-d5e2-4bf7-b0fc-ccaa10f5f763 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.209857 Jan 11 14:13:51.200172 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-312a3eca-df59-4a05-ab1f-254ab4b57a48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.223581 Jan 11 14:13:51.201067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 74/139] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:50 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:51.208129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 66/140] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:50 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:51.287191 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-cf8baa9a-91ff-4e10-801e-7b85f5df358b req-e14424d1-1cbe-4016-9f56-f0a1d8f6d08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdb5bf8-cc2d-4e01-ad4d-6a9647801384", "name": "network-vif-plugged", "status": "completed", "tag": "77e99707-79d4-42da-8053-2f361200d181"}, {"server_uuid": "aa034417-f545-486a-9795-890931667012", "name": "network-vif-plugged", "status": "completed", "tag": "5a970ee5-fb4e-433b-a01a-9adab15fef70"}, {"server_uuid": "07361687-ec7a-4f6e-8e42-530c1a64ba04", "name": "network-vif-plugged", "status": "completed", "tag": "c51643c6-7fc4-41fe-bb8c-e237ddadcdaf"}, {"server_uuid": "da33a406-0839-4a04-9800-1444f9ae0b82", "name": "network-vif-plugged", "status": "completed", "tag": "4d8257f7-0bfc-4ec4-85ba-6f20d746300d"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:13:51.289184 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:13:51.289184 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:13:51.297950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-cf8baa9a-91ff-4e10-801e-7b85f5df358b req-e14424d1-1cbe-4016-9f56-f0a1d8f6d08d service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:51.298379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-cf8baa9a-91ff-4e10-801e-7b85f5df358b req-e14424d1-1cbe-4016-9f56-f0a1d8f6d08d service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:51.315100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-cf8baa9a-91ff-4e10-801e-7b85f5df358b req-e14424d1-1cbe-4016-9f56-f0a1d8f6d08d service nova] Creating event network-vif-plugged:77e99707-79d4-42da-8053-2f361200d181 for instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 on hv-cinder-82413 Jan 11 14:13:51.315616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-cf8baa9a-91ff-4e10-801e-7b85f5df358b req-e14424d1-1cbe-4016-9f56-f0a1d8f6d08d service nova] Creating event network-vif-plugged:5a970ee5-fb4e-433b-a01a-9adab15fef70 for instance aa034417-f545-486a-9795-890931667012 on hv-cinder-82413 Jan 11 14:13:51.316110 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-cf8baa9a-91ff-4e10-801e-7b85f5df358b req-e14424d1-1cbe-4016-9f56-f0a1d8f6d08d service nova] Creating event network-vif-plugged:c51643c6-7fc4-41fe-bb8c-e237ddadcdaf for instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 on hv-cinder-82413 Jan 11 14:13:51.316599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-cf8baa9a-91ff-4e10-801e-7b85f5df358b req-e14424d1-1cbe-4016-9f56-f0a1d8f6d08d service nova] Creating event network-vif-plugged:4d8257f7-0bfc-4ec4-85ba-6f20d746300d for instance da33a406-0839-4a04-9800-1444f9ae0b82 on hv-cinder-82413 Jan 11 14:13:51.326566 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-cf8baa9a-91ff-4e10-801e-7b85f5df358b req-e14424d1-1cbe-4016-9f56-f0a1d8f6d08d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.043103 Jan 11 14:13:51.327477 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 75/141] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:13:51.910173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-866948ad-bc36-4a8b-9448-84a28ad25cca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:51.910775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-866948ad-bc36-4a8b-9448-84a28ad25cca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:51.914569 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bdfd7a04-1620-4b55-a22a-cb02e8a583ce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:51.915342 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bdfd7a04-1620-4b55-a22a-cb02e8a583ce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:51.916558 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-866948ad-bc36-4a8b-9448-84a28ad25cca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:51.917012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-866948ad-bc36-4a8b-9448-84a28ad25cca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:51.917794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-866948ad-bc36-4a8b-9448-84a28ad25cca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:51.918233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-866948ad-bc36-4a8b-9448-84a28ad25cca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:51.922102 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdfd7a04-1620-4b55-a22a-cb02e8a583ce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:51.922624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdfd7a04-1620-4b55-a22a-cb02e8a583ce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:51.923485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdfd7a04-1620-4b55-a22a-cb02e8a583ce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:51.924011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdfd7a04-1620-4b55-a22a-cb02e8a583ce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:52.112255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-866948ad-bc36-4a8b-9448-84a28ad25cca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:52.116752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-bdfd7a04-1620-4b55-a22a-cb02e8a583ce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:52.119489 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-866948ad-bc36-4a8b-9448-84a28ad25cca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.212939 Jan 11 14:13:52.120245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 67/142] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:51 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:52.124437 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bdfd7a04-1620-4b55-a22a-cb02e8a583ce tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.214092 Jan 11 14:13:52.124993 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 76/143] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:51 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:52.218359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:52.218971 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:52.223720 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2af11741-d9b2-4a45-85ea-7b25d151b9cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:52.224493 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2af11741-d9b2-4a45-85ea-7b25d151b9cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:52.225037 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:52.225485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:52.226273 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:52.226713 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:52.230244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2af11741-d9b2-4a45-85ea-7b25d151b9cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:52.230694 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2af11741-d9b2-4a45-85ea-7b25d151b9cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:52.231472 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2af11741-d9b2-4a45-85ea-7b25d151b9cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:52.232455 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2af11741-d9b2-4a45-85ea-7b25d151b9cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:52.424445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:52.427625 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2af11741-d9b2-4a45-85ea-7b25d151b9cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:52.432443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:52.434008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:52.435127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-58df190b-25c0-43ac-a382-165d68126f7e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.220953 Jan 11 14:13:52.435229 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2af11741-d9b2-4a45-85ea-7b25d151b9cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.214933 Jan 11 14:13:52.435715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 68/144] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:52 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:52.435987 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 77/145] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:52 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:53.135835 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7a51fb9a-0043-41c7-80ad-aff0ead0ab75 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:53.136418 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7a51fb9a-0043-41c7-80ad-aff0ead0ab75 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:53.140413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-776e9af6-2176-46cb-9930-660cafe1b214 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:53.141017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-776e9af6-2176-46cb-9930-660cafe1b214 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:53.142703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a51fb9a-0043-41c7-80ad-aff0ead0ab75 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:53.143149 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a51fb9a-0043-41c7-80ad-aff0ead0ab75 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:53.143955 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a51fb9a-0043-41c7-80ad-aff0ead0ab75 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:53.144394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a51fb9a-0043-41c7-80ad-aff0ead0ab75 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:53.146646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-776e9af6-2176-46cb-9930-660cafe1b214 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:53.147090 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-776e9af6-2176-46cb-9930-660cafe1b214 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:53.147892 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-776e9af6-2176-46cb-9930-660cafe1b214 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:53.148329 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-776e9af6-2176-46cb-9930-660cafe1b214 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:53.329492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7a51fb9a-0043-41c7-80ad-aff0ead0ab75 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:53.336311 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-776e9af6-2176-46cb-9930-660cafe1b214 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:53.337039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7a51fb9a-0043-41c7-80ad-aff0ead0ab75 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.204659 Jan 11 14:13:53.337548 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 69/146] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:53 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:53.344273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-776e9af6-2176-46cb-9930-660cafe1b214 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.207890 Jan 11 14:13:53.344833 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 78/147] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:53 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:53.454037 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7d0655c2-8219-4a1d-88ea-b4d50fa86525 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:53.454823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:53.455285 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7d0655c2-8219-4a1d-88ea-b4d50fa86525 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:53.455925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:53.463003 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7d0655c2-8219-4a1d-88ea-b4d50fa86525 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:53.463739 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7d0655c2-8219-4a1d-88ea-b4d50fa86525 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:53.464198 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:53.464784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:53.465114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7d0655c2-8219-4a1d-88ea-b4d50fa86525 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:53.465646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7d0655c2-8219-4a1d-88ea-b4d50fa86525 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:53.466340 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:53.466923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:53.654046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7d0655c2-8219-4a1d-88ea-b4d50fa86525 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:53.658510 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:53.661606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7d0655c2-8219-4a1d-88ea-b4d50fa86525 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.212373 Jan 11 14:13:53.662311 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 70/148] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:53 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:53.666941 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:53.668429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:53.669518 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e178dd42-0785-4aa7-b37f-3c5edd2f3e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.220081 Jan 11 14:13:53.670290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 79/149] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:53 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:54.353426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6effe76f-8c44-4914-ae10-cc92386f15a3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:54.353952 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6effe76f-8c44-4914-ae10-cc92386f15a3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:54.360323 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-df4fdbb6-5e76-4d68-820a-cdc94d7f8455 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:54.360830 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6effe76f-8c44-4914-ae10-cc92386f15a3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:54.360936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-df4fdbb6-5e76-4d68-820a-cdc94d7f8455 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:54.361017 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6effe76f-8c44-4914-ae10-cc92386f15a3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:54.361786 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6effe76f-8c44-4914-ae10-cc92386f15a3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:54.362213 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6effe76f-8c44-4914-ae10-cc92386f15a3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:54.367761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-df4fdbb6-5e76-4d68-820a-cdc94d7f8455 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:54.368203 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-df4fdbb6-5e76-4d68-820a-cdc94d7f8455 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:54.368986 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-df4fdbb6-5e76-4d68-820a-cdc94d7f8455 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:54.369421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-df4fdbb6-5e76-4d68-820a-cdc94d7f8455 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:54.557679 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6effe76f-8c44-4914-ae10-cc92386f15a3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:54.561100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-df4fdbb6-5e76-4d68-820a-cdc94d7f8455 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:54.565005 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6effe76f-8c44-4914-ae10-cc92386f15a3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.215346 Jan 11 14:13:54.565580 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 71/150] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:54 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:54.568337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-df4fdbb6-5e76-4d68-820a-cdc94d7f8455 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.211678 Jan 11 14:13:54.568897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 80/151] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:54 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:54.679850 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f2645c86-2f86-41d3-8e43-3be4a30654c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:54.680451 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f2645c86-2f86-41d3-8e43-3be4a30654c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:54.686367 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f2645c86-2f86-41d3-8e43-3be4a30654c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:54.686809 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f2645c86-2f86-41d3-8e43-3be4a30654c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:54.687600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f2645c86-2f86-41d3-8e43-3be4a30654c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:54.688029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f2645c86-2f86-41d3-8e43-3be4a30654c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:54.689326 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:54.690710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:54.696571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:54.697100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:54.698150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:54.698591 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:54.881572 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f2645c86-2f86-41d3-8e43-3be4a30654c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:54.885276 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:54.890092 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f2645c86-2f86-41d3-8e43-3be4a30654c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.213998 Jan 11 14:13:54.890838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 72/152] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:54 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:54.902237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:54.904352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:54.905454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-831a2f07-8650-4dae-abf6-6a681a28f820 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.220216 Jan 11 14:13:54.906013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 81/153] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:54 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:55.581757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a59849f3-7bef-4339-a7dc-f3cb0657c179 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:55.582365 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a59849f3-7bef-4339-a7dc-f3cb0657c179 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:55.585395 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-27c78b42-3767-4542-ae9a-be644b9139c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:55.586608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-27c78b42-3767-4542-ae9a-be644b9139c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:55.588254 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a59849f3-7bef-4339-a7dc-f3cb0657c179 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:55.588696 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a59849f3-7bef-4339-a7dc-f3cb0657c179 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:55.589471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a59849f3-7bef-4339-a7dc-f3cb0657c179 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:55.589896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a59849f3-7bef-4339-a7dc-f3cb0657c179 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:55.592402 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27c78b42-3767-4542-ae9a-be644b9139c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:55.592862 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27c78b42-3767-4542-ae9a-be644b9139c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:55.593620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27c78b42-3767-4542-ae9a-be644b9139c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:55.594061 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27c78b42-3767-4542-ae9a-be644b9139c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:55.805772 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a59849f3-7bef-4339-a7dc-f3cb0657c179 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:55.814230 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-27c78b42-3767-4542-ae9a-be644b9139c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:55.814380 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a59849f3-7bef-4339-a7dc-f3cb0657c179 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.236585 Jan 11 14:13:55.814800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 73/154] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:55 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:55.821642 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-27c78b42-3767-4542-ae9a-be644b9139c8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.240043 Jan 11 14:13:55.822325 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 82/155] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:55 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:55.906126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6d9ceef6-d6df-4f5e-9a0e-7073bf9edc09 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:55.906726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6d9ceef6-d6df-4f5e-9a0e-7073bf9edc09 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:55.912914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6d9ceef6-d6df-4f5e-9a0e-7073bf9edc09 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:55.913410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6d9ceef6-d6df-4f5e-9a0e-7073bf9edc09 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:55.914194 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6d9ceef6-d6df-4f5e-9a0e-7073bf9edc09 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:55.914671 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6d9ceef6-d6df-4f5e-9a0e-7073bf9edc09 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:55.924635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:55.925968 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:55.936430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:55.937107 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:55.938546 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:55.939177 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:56.157828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6d9ceef6-d6df-4f5e-9a0e-7073bf9edc09 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:56.169384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:56.174585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6d9ceef6-d6df-4f5e-9a0e-7073bf9edc09 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.272090 Jan 11 14:13:56.176040 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 74/156] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:55 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:56.184215 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:56.188117 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:56.190619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d82caf4d-f597-489e-b937-2fd0cc3ad004 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.269201 Jan 11 14:13:56.191965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 83/157] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:55 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:13:56.834100 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-95c7048a-16c1-4397-bd0d-114f10deaba3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:56.834827 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-95c7048a-16c1-4397-bd0d-114f10deaba3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:56.837587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b186b7cf-9f4a-4467-8663-702afa6b7c77 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:56.838200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b186b7cf-9f4a-4467-8663-702afa6b7c77 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:56.841135 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95c7048a-16c1-4397-bd0d-114f10deaba3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:56.841588 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95c7048a-16c1-4397-bd0d-114f10deaba3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:56.842381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95c7048a-16c1-4397-bd0d-114f10deaba3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:56.842853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95c7048a-16c1-4397-bd0d-114f10deaba3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:56.844452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b186b7cf-9f4a-4467-8663-702afa6b7c77 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:56.844899 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b186b7cf-9f4a-4467-8663-702afa6b7c77 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:56.845879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b186b7cf-9f4a-4467-8663-702afa6b7c77 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:56.846312 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b186b7cf-9f4a-4467-8663-702afa6b7c77 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:57.035692 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-95c7048a-16c1-4397-bd0d-114f10deaba3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:57.043279 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-95c7048a-16c1-4397-bd0d-114f10deaba3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.215773 Jan 11 14:13:57.044951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 75/158] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:56 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:57.048584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b186b7cf-9f4a-4467-8663-702afa6b7c77 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:57.055849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b186b7cf-9f4a-4467-8663-702afa6b7c77 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.221719 Jan 11 14:13:57.056427 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 84/159] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:56 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:57.192232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8cd2527d-6980-44ad-9c26-f273cdb365e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:57.192864 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8cd2527d-6980-44ad-9c26-f273cdb365e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:57.199055 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8cd2527d-6980-44ad-9c26-f273cdb365e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:57.199518 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8cd2527d-6980-44ad-9c26-f273cdb365e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:57.200856 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8cd2527d-6980-44ad-9c26-f273cdb365e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:57.201313 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8cd2527d-6980-44ad-9c26-f273cdb365e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:57.209693 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:57.210298 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:57.216412 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:57.216849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:57.217638 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:57.218083 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:57.398823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8cd2527d-6980-44ad-9c26-f273cdb365e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:57.402917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:57.406300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8cd2527d-6980-44ad-9c26-f273cdb365e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.217705 Jan 11 14:13:57.406869 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 76/160] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:57 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:57.410772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:57.412432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:57.413874 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9d0bf86a-6d49-44c4-a116-9946d20c3fb1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.207466 Jan 11 14:13:57.414411 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 85/161] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:57 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:58.060883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0338a0cd-c1e9-4b01-9bba-ee961a6a8461 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:58.061541 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0338a0cd-c1e9-4b01-9bba-ee961a6a8461 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:58.073980 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a32114af-7ed5-49ce-a2db-fe19df731993 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:58.074547 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a32114af-7ed5-49ce-a2db-fe19df731993 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:58.079903 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0338a0cd-c1e9-4b01-9bba-ee961a6a8461 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:58.080451 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0338a0cd-c1e9-4b01-9bba-ee961a6a8461 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:58.081378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0338a0cd-c1e9-4b01-9bba-ee961a6a8461 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:58.081670 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a32114af-7ed5-49ce-a2db-fe19df731993 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:58.082005 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0338a0cd-c1e9-4b01-9bba-ee961a6a8461 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:58.082100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a32114af-7ed5-49ce-a2db-fe19df731993 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:58.082872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a32114af-7ed5-49ce-a2db-fe19df731993 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:58.083304 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a32114af-7ed5-49ce-a2db-fe19df731993 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:58.273573 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a32114af-7ed5-49ce-a2db-fe19df731993 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:58.280927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a32114af-7ed5-49ce-a2db-fe19df731993 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.212535 Jan 11 14:13:58.283611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 86/162] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:58 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:58.283771 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0338a0cd-c1e9-4b01-9bba-ee961a6a8461 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:58.290151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0338a0cd-c1e9-4b01-9bba-ee961a6a8461 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.233516 Jan 11 14:13:58.290701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 77/163] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:58 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:58.423463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e1427331-57ef-4100-84b6-bcb70f7cb266 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:58.424101 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e1427331-57ef-4100-84b6-bcb70f7cb266 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:58.430136 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1427331-57ef-4100-84b6-bcb70f7cb266 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:58.430584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1427331-57ef-4100-84b6-bcb70f7cb266 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:58.431103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:58.431361 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1427331-57ef-4100-84b6-bcb70f7cb266 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:58.431764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:58.431867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1427331-57ef-4100-84b6-bcb70f7cb266 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:58.438027 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:58.438470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:58.439239 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:58.439714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:58.630084 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e1427331-57ef-4100-84b6-bcb70f7cb266 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:58.634146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:58.637503 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e1427331-57ef-4100-84b6-bcb70f7cb266 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.217673 Jan 11 14:13:58.638058 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 87/164] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:58 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:58.641862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:58.643365 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:58.644474 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e5e50371-36ec-4428-bdc3-4a9b10a68147 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.217129 Jan 11 14:13:58.645008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 78/165] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:58 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:13:59.298345 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-63b47dc7-339e-486a-a83f-71274cdc3d3c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:59.298991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-63b47dc7-339e-486a-a83f-71274cdc3d3c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:59.304991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-63b47dc7-339e-486a-a83f-71274cdc3d3c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:59.305459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-63b47dc7-339e-486a-a83f-71274cdc3d3c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:59.306191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3f8c66c7-6479-481f-99b3-fefd8b81ed02 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:59.306616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-63b47dc7-339e-486a-a83f-71274cdc3d3c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:59.306616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-63b47dc7-339e-486a-a83f-71274cdc3d3c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:59.306773 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3f8c66c7-6479-481f-99b3-fefd8b81ed02 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:59.312994 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3f8c66c7-6479-481f-99b3-fefd8b81ed02 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:59.313435 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3f8c66c7-6479-481f-99b3-fefd8b81ed02 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:59.314201 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3f8c66c7-6479-481f-99b3-fefd8b81ed02 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:59.314628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3f8c66c7-6479-481f-99b3-fefd8b81ed02 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:59.671957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-63b47dc7-339e-486a-a83f-71274cdc3d3c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:59.675581 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3f8c66c7-6479-481f-99b3-fefd8b81ed02 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:59.679727 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-63b47dc7-339e-486a-a83f-71274cdc3d3c tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.384988 Jan 11 14:13:59.680293 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 88/166] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:59 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:59.682931 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3f8c66c7-6479-481f-99b3-fefd8b81ed02 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.380287 Jan 11 14:13:59.685335 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f5941c4c-6146-48be-a6aa-2385fc672228 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:59.685929 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f5941c4c-6146-48be-a6aa-2385fc672228 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:59.689884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 79/167] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:59 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:13:59.691837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5941c4c-6146-48be-a6aa-2385fc672228 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:59.692279 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5941c4c-6146-48be-a6aa-2385fc672228 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:59.693055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5941c4c-6146-48be-a6aa-2385fc672228 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:59.693481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5941c4c-6146-48be-a6aa-2385fc672228 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:59.701865 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:13:59.702182 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:13:59.708309 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:59.709576 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:59.710380 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:13:59.710842 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:13:59.890353 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f5941c4c-6146-48be-a6aa-2385fc672228 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:59.893884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:59.897586 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f5941c4c-6146-48be-a6aa-2385fc672228 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.216356 Jan 11 14:13:59.898152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 89/168] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:13:59 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:13:59.901840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:59.903589 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:13:59.904755 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d3ef395d-bc84-47c4-910b-e6c626ed18aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.213606 Jan 11 14:13:59.905377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 80/169] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:13:59 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:14:00.696773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-72c9b260-bed3-489d-b24e-ab8ecf0e0ce9 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:00.697331 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-72c9b260-bed3-489d-b24e-ab8ecf0e0ce9 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:00.703604 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-72c9b260-bed3-489d-b24e-ab8ecf0e0ce9 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:00.704055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-72c9b260-bed3-489d-b24e-ab8ecf0e0ce9 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:00.704918 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-72c9b260-bed3-489d-b24e-ab8ecf0e0ce9 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:00.705380 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-72c9b260-bed3-489d-b24e-ab8ecf0e0ce9 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:00.709166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cc90930e-02e2-4bb6-924d-099e61697c44 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:00.709907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cc90930e-02e2-4bb6-924d-099e61697c44 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:00.716460 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cc90930e-02e2-4bb6-924d-099e61697c44 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:00.717205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cc90930e-02e2-4bb6-924d-099e61697c44 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:00.717958 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cc90930e-02e2-4bb6-924d-099e61697c44 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:00.718499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cc90930e-02e2-4bb6-924d-099e61697c44 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:00.892568 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-72c9b260-bed3-489d-b24e-ab8ecf0e0ce9 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:00.900101 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-72c9b260-bed3-489d-b24e-ab8ecf0e0ce9 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.206999 Jan 11 14:14:00.900672 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 90/170] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:00 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:00.908378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cc90930e-02e2-4bb6-924d-099e61697c44 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:00.913570 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-22351d50-1ece-45ac-97ec-2e7204694cd5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:00.914202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-22351d50-1ece-45ac-97ec-2e7204694cd5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:00.915981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cc90930e-02e2-4bb6-924d-099e61697c44 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.212034 Jan 11 14:14:00.916828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 81/171] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:00 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:00.921134 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22351d50-1ece-45ac-97ec-2e7204694cd5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:00.921599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22351d50-1ece-45ac-97ec-2e7204694cd5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:00.922010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:00.922528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22351d50-1ece-45ac-97ec-2e7204694cd5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:00.922626 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:00.922972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22351d50-1ece-45ac-97ec-2e7204694cd5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:00.928001 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:00.928442 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:00.929202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:00.929629 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:01.118556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:01.123021 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-22351d50-1ece-45ac-97ec-2e7204694cd5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:01.126798 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:01.128435 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:01.129525 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-73f8acce-6bd8-43da-b8b8-4e385da5326f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.211474 Jan 11 14:14:01.130082 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 82/172] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:14:00 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:14:01.130358 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-22351d50-1ece-45ac-97ec-2e7204694cd5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.220243 Jan 11 14:14:01.131155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 91/173] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:00 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:01.917191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-900dab30-0356-461a-97c4-166ba0ff2204 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:01.917804 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-900dab30-0356-461a-97c4-166ba0ff2204 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:01.924336 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-900dab30-0356-461a-97c4-166ba0ff2204 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:01.924782 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-900dab30-0356-461a-97c4-166ba0ff2204 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:01.925651 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-900dab30-0356-461a-97c4-166ba0ff2204 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:01.926400 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-900dab30-0356-461a-97c4-166ba0ff2204 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:01.934186 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-840795a5-ef0b-45b0-b14a-04e0cd3b8356 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:01.935041 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-840795a5-ef0b-45b0-b14a-04e0cd3b8356 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:01.941552 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-840795a5-ef0b-45b0-b14a-04e0cd3b8356 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:01.942234 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-840795a5-ef0b-45b0-b14a-04e0cd3b8356 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:01.943397 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-840795a5-ef0b-45b0-b14a-04e0cd3b8356 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:01.943859 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-840795a5-ef0b-45b0-b14a-04e0cd3b8356 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:02.142122 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-900dab30-0356-461a-97c4-166ba0ff2204 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:02.144726 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-840795a5-ef0b-45b0-b14a-04e0cd3b8356 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:02.149477 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-900dab30-0356-461a-97c4-166ba0ff2204 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1315 microversion: 2.1 time: 0.235908 Jan 11 14:14:02.150127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 83/174] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:01 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:02.154993 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-840795a5-ef0b-45b0-b14a-04e0cd3b8356 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1322 microversion: 2.1 time: 0.225359 Jan 11 14:14:02.163753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-09ef7842-af00-4f91-ac80-059496b9f604 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:02.163753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-09ef7842-af00-4f91-ac80-059496b9f604 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:02.163753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-09ef7842-af00-4f91-ac80-059496b9f604 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:02.163753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-09ef7842-af00-4f91-ac80-059496b9f604 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:02.164377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-09ef7842-af00-4f91-ac80-059496b9f604 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:02.164700 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 92/175] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:01 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:02.164805 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-09ef7842-af00-4f91-ac80-059496b9f604 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:02.170881 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:02.171510 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:02.179017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:02.179837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:02.180888 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:02.181467 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:02.381854 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:02.389774 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:02.391295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:02.392424 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-61d384e8-aba8-4dd0-a566-febd1453ec58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1405 microversion: 2.20 time: 0.226355 Jan 11 14:14:02.392978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 93/176] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:14:02 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:14:02.393202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-09ef7842-af00-4f91-ac80-059496b9f604 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:02.400484 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-09ef7842-af00-4f91-ac80-059496b9f604 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1362 microversion: 2.1 time: 0.249247 Jan 11 14:14:02.401130 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 84/177] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:02 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:03.166491 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-69f987a3-151f-4c74-b22d-20e17707b8d8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:03.167246 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-69f987a3-151f-4c74-b22d-20e17707b8d8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:03.175397 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69f987a3-151f-4c74-b22d-20e17707b8d8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.176130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69f987a3-151f-4c74-b22d-20e17707b8d8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.176978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69f987a3-151f-4c74-b22d-20e17707b8d8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.177476 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69f987a3-151f-4c74-b22d-20e17707b8d8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.181428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9de92a1f-6517-4ae9-8065-00944ce0e523 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:03.182058 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9de92a1f-6517-4ae9-8065-00944ce0e523 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:03.187957 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9de92a1f-6517-4ae9-8065-00944ce0e523 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.188555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9de92a1f-6517-4ae9-8065-00944ce0e523 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.189354 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9de92a1f-6517-4ae9-8065-00944ce0e523 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.190156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9de92a1f-6517-4ae9-8065-00944ce0e523 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.397817 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-69f987a3-151f-4c74-b22d-20e17707b8d8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:03.402308 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9de92a1f-6517-4ae9-8065-00944ce0e523 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:03.407681 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-69f987a3-151f-4c74-b22d-20e17707b8d8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1501 microversion: 2.1 time: 0.245000 Jan 11 14:14:03.408263 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 94/178] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:03 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:03.410013 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9de92a1f-6517-4ae9-8065-00944ce0e523 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1515 microversion: 2.1 time: 0.237553 Jan 11 14:14:03.410557 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 85/179] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:03 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:03.412846 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:03.413635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:03.419757 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.420393 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.421571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.422347 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.422612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-82e4c3c8-9dfe-4470-b877-101aad79b3b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:03.423535 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-82e4c3c8-9dfe-4470-b877-101aad79b3b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:03.432482 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-82e4c3c8-9dfe-4470-b877-101aad79b3b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.432933 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-82e4c3c8-9dfe-4470-b877-101aad79b3b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.434182 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-82e4c3c8-9dfe-4470-b877-101aad79b3b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.435282 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-82e4c3c8-9dfe-4470-b877-101aad79b3b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.647699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:03.656736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:03.660228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:03.666005 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c8911687-a734-4ef3-b57c-e109c4580029 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1596 microversion: 2.20 time: 0.256712 Jan 11 14:14:03.666593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 95/180] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:14:03 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1596 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:14:03.667800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-82e4c3c8-9dfe-4470-b877-101aad79b3b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:03.671827 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2ae5e78e-42ed-465b-be88-20de2b11dc1d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:03.673077 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2ae5e78e-42ed-465b-be88-20de2b11dc1d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:03.679744 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2ae5e78e-42ed-465b-be88-20de2b11dc1d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.680464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2ae5e78e-42ed-465b-be88-20de2b11dc1d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.681434 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2ae5e78e-42ed-465b-be88-20de2b11dc1d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.682225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2ae5e78e-42ed-465b-be88-20de2b11dc1d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.701655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-82e4c3c8-9dfe-4470-b877-101aad79b3b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1548 microversion: 2.1 time: 0.283880 Jan 11 14:14:03.705540 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 86/181] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:03 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1548 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:03.713854 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-abf6f5f6-86c7-4318-a289-e022bed55e68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:03.725304 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-abf6f5f6-86c7-4318-a289-e022bed55e68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:03.738170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-abf6f5f6-86c7-4318-a289-e022bed55e68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.738722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-abf6f5f6-86c7-4318-a289-e022bed55e68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.739657 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-abf6f5f6-86c7-4318-a289-e022bed55e68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.740192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-abf6f5f6-86c7-4318-a289-e022bed55e68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.771656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-2ae5e78e-42ed-465b-be88-20de2b11dc1d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lazy-loading 'flavor' on Instance uuid aa034417-f545-486a-9795-890931667012 {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:14:03.883338 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-abf6f5f6-86c7-4318-a289-e022bed55e68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.176783 Jan 11 14:14:03.884236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 87/182] 10.222.0.49 () {60 vars in 1315 bytes} [Tue Jan 11 14:14:03 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:03.889284 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7c03ad5d-f241-46c5-a024-d819baa07dab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:03.889916 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7c03ad5d-f241-46c5-a024-d819baa07dab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:03.907682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c03ad5d-f241-46c5-a024-d819baa07dab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.908145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c03ad5d-f241-46c5-a024-d819baa07dab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.909119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c03ad5d-f241-46c5-a024-d819baa07dab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.909630 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c03ad5d-f241-46c5-a024-d819baa07dab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.925868 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2ae5e78e-42ed-465b-be88-20de2b11dc1d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012/action" status: 200 len: 32 microversion: 2.1 time: 0.257816 Jan 11 14:14:03.926726 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 96/183] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:03 2022] POST /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:14:03.969560 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c2a571fd-a09d-402b-b040-fe2e7d1a348c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:03.970614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c2a571fd-a09d-402b-b040-fe2e7d1a348c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:03.980539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c2a571fd-a09d-402b-b040-fe2e7d1a348c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.981896 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c2a571fd-a09d-402b-b040-fe2e7d1a348c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:03.982940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c2a571fd-a09d-402b-b040-fe2e7d1a348c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:03.983470 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c2a571fd-a09d-402b-b040-fe2e7d1a348c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:04.229922 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7c03ad5d-f241-46c5-a024-d819baa07dab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.344860 Jan 11 14:14:04.230477 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 88/184] 10.222.0.49 () {58 vars in 1274 bytes} [Tue Jan 11 14:14:03 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/os-interface => generated 284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:04.470086 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c2a571fd-a09d-402b-b040-fe2e7d1a348c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:04.484437 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c2a571fd-a09d-402b-b040-fe2e7d1a348c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.530459 Jan 11 14:14:04.485810 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 97/185] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:03 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:05.083803 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f00d4ecf-0dda-48f7-a65f-6202aff97ef0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a74e43f-d671-458e-9a45-ddbd2b907fab"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:05.085037 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f00d4ecf-0dda-48f7-a65f-6202aff97ef0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:05.091959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f00d4ecf-0dda-48f7-a65f-6202aff97ef0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:05.092505 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f00d4ecf-0dda-48f7-a65f-6202aff97ef0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:05.093529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f00d4ecf-0dda-48f7-a65f-6202aff97ef0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:05.094200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f00d4ecf-0dda-48f7-a65f-6202aff97ef0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:05.502652 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-736ba474-b2e2-45d2-b2a6-a4c6e8670070 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:05.503918 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-736ba474-b2e2-45d2-b2a6-a4c6e8670070 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:05.511851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-736ba474-b2e2-45d2-b2a6-a4c6e8670070 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:05.514447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-736ba474-b2e2-45d2-b2a6-a4c6e8670070 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:05.515416 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-736ba474-b2e2-45d2-b2a6-a4c6e8670070 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:05.516036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-736ba474-b2e2-45d2-b2a6-a4c6e8670070 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:05.790267 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-736ba474-b2e2-45d2-b2a6-a4c6e8670070 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:05.798332 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-736ba474-b2e2-45d2-b2a6-a4c6e8670070 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.299470 Jan 11 14:14:05.807834 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 98/186] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:05 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:05.813409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1f3d8a5f-2a32-41b3-b9b9-2d7b1b41ae93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:05.814440 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1f3d8a5f-2a32-41b3-b9b9-2d7b1b41ae93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:05.820503 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1f3d8a5f-2a32-41b3-b9b9-2d7b1b41ae93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:05.821028 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1f3d8a5f-2a32-41b3-b9b9-2d7b1b41ae93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:05.821884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1f3d8a5f-2a32-41b3-b9b9-2d7b1b41ae93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:05.822402 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1f3d8a5f-2a32-41b3-b9b9-2d7b1b41ae93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:10.014513 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1f3d8a5f-2a32-41b3-b9b9-2d7b1b41ae93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 14 microversion: 2.1 time: 4.205146 Jan 11 14:14:10.015360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 99/187] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:05 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 14 bytes in 4207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:14:10.020365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-3a4b80ea-ed82-4dd6-89df-20c00eb5ad21 req-d43d7a84-7e3b-4158-936b-5bb09e41be01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da33a406-0839-4a04-9800-1444f9ae0b82", "tag": "4d8257f7-0bfc-4ec4-85ba-6f20d746300d"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:10.021836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:10.021836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:14:10.032594 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-3a4b80ea-ed82-4dd6-89df-20c00eb5ad21 req-d43d7a84-7e3b-4158-936b-5bb09e41be01 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:10.033254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-3a4b80ea-ed82-4dd6-89df-20c00eb5ad21 req-d43d7a84-7e3b-4158-936b-5bb09e41be01 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:10.044854 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-3a4b80ea-ed82-4dd6-89df-20c00eb5ad21 req-d43d7a84-7e3b-4158-936b-5bb09e41be01 service nova] Creating event network-changed:4d8257f7-0bfc-4ec4-85ba-6f20d746300d for instance da33a406-0839-4a04-9800-1444f9ae0b82 on hv-cinder-82413 Jan 11 14:14:10.050042 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-3a4b80ea-ed82-4dd6-89df-20c00eb5ad21 req-d43d7a84-7e3b-4158-936b-5bb09e41be01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033351 Jan 11 14:14:10.050700 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 100/188] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:10.057584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-da3056ae-b21f-4792-a8a0-1df304ea880f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:10.058577 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-da3056ae-b21f-4792-a8a0-1df304ea880f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:10.066049 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-da3056ae-b21f-4792-a8a0-1df304ea880f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:10.067292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-da3056ae-b21f-4792-a8a0-1df304ea880f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:10.068182 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-da3056ae-b21f-4792-a8a0-1df304ea880f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:10.068614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-da3056ae-b21f-4792-a8a0-1df304ea880f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:10.156893 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-da3056ae-b21f-4792-a8a0-1df304ea880f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 14 microversion: 2.20 time: 0.104555 Jan 11 14:14:10.157863 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 101/189] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:10 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:10.162860 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-fcf98c89-4da0-4a55-89db-06d7aa77c461 req-28f23cb9-5816-47d9-b452-907524e6bd30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07361687-ec7a-4f6e-8e42-530c1a64ba04", "tag": "c51643c6-7fc4-41fe-bb8c-e237ddadcdaf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:10.168274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:10.168274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:14:10.177571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-fcf98c89-4da0-4a55-89db-06d7aa77c461 req-28f23cb9-5816-47d9-b452-907524e6bd30 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:10.178023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-fcf98c89-4da0-4a55-89db-06d7aa77c461 req-28f23cb9-5816-47d9-b452-907524e6bd30 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:10.191332 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-fcf98c89-4da0-4a55-89db-06d7aa77c461 req-28f23cb9-5816-47d9-b452-907524e6bd30 service nova] Creating event network-changed:c51643c6-7fc4-41fe-bb8c-e237ddadcdaf for instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 on hv-cinder-82413 Jan 11 14:14:10.191707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f00d4ecf-0dda-48f7-a65f-6202aff97ef0 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "POST /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.111383 Jan 11 14:14:10.192439 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 89/190] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:14:05 2022] POST /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c/os-volume_attachments => generated 194 bytes in 5113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:10.199764 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-fcf98c89-4da0-4a55-89db-06d7aa77c461 req-28f23cb9-5816-47d9-b452-907524e6bd30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040140 Jan 11 14:14:10.200491 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 102/191] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:10.208123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fe1f7167-280e-4078-9b09-27af832f2002 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:10.209966 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fe1f7167-280e-4078-9b09-27af832f2002 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:10.219598 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe1f7167-280e-4078-9b09-27af832f2002 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:10.220282 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe1f7167-280e-4078-9b09-27af832f2002 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:10.221897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe1f7167-280e-4078-9b09-27af832f2002 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:10.222729 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe1f7167-280e-4078-9b09-27af832f2002 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:10.467011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fe1f7167-280e-4078-9b09-27af832f2002 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:10.474488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fe1f7167-280e-4078-9b09-27af832f2002 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.280699 Jan 11 14:14:10.475060 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 90/192] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:10 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:11.026826 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-43f08133-8c8c-40af-8566-12f1f69f40b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:11.027815 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-43f08133-8c8c-40af-8566-12f1f69f40b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:11.034255 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-43f08133-8c8c-40af-8566-12f1f69f40b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:11.034704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-43f08133-8c8c-40af-8566-12f1f69f40b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:11.035518 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-43f08133-8c8c-40af-8566-12f1f69f40b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:11.035963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-43f08133-8c8c-40af-8566-12f1f69f40b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:11.168155 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-aa1a121c-ab02-41ad-b162-90549e0dc578 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:11.170259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-aa1a121c-ab02-41ad-b162-90549e0dc578 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:11.176479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa1a121c-ab02-41ad-b162-90549e0dc578 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:11.176929 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa1a121c-ab02-41ad-b162-90549e0dc578 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:11.177726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa1a121c-ab02-41ad-b162-90549e0dc578 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:11.178170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa1a121c-ab02-41ad-b162-90549e0dc578 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:11.250987 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-43f08133-8c8c-40af-8566-12f1f69f40b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 14 microversion: 2.1 time: 0.228387 Jan 11 14:14:11.252996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 103/193] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:11 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:14:11.424019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-aa1a121c-ab02-41ad-b162-90549e0dc578 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 14 microversion: 2.20 time: 0.259190 Jan 11 14:14:11.424747 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 91/194] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:11 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 14 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:11.492160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-634dd294-4dde-40f8-a63d-8826cf205e97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:11.492894 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-634dd294-4dde-40f8-a63d-8826cf205e97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:11.499651 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-634dd294-4dde-40f8-a63d-8826cf205e97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:11.500107 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-634dd294-4dde-40f8-a63d-8826cf205e97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:11.500884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-634dd294-4dde-40f8-a63d-8826cf205e97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:11.501316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-634dd294-4dde-40f8-a63d-8826cf205e97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:11.633662 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-634dd294-4dde-40f8-a63d-8826cf205e97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:11.641514 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-634dd294-4dde-40f8-a63d-8826cf205e97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.153408 Jan 11 14:14:11.642072 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 104/195] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:11 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:12.264778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-52303a0a-bcad-4e09-910e-e6874dd6b53a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:12.265715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-52303a0a-bcad-4e09-910e-e6874dd6b53a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:12.272403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-52303a0a-bcad-4e09-910e-e6874dd6b53a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:12.272950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-52303a0a-bcad-4e09-910e-e6874dd6b53a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:12.273763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-52303a0a-bcad-4e09-910e-e6874dd6b53a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:12.274202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-52303a0a-bcad-4e09-910e-e6874dd6b53a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:12.434742 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9f00067b-52f1-4620-ae19-af1623446ef4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:12.435731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9f00067b-52f1-4620-ae19-af1623446ef4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:12.441973 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f00067b-52f1-4620-ae19-af1623446ef4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:12.442419 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f00067b-52f1-4620-ae19-af1623446ef4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:12.443192 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f00067b-52f1-4620-ae19-af1623446ef4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:12.443655 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f00067b-52f1-4620-ae19-af1623446ef4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:15.510504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-52303a0a-bcad-4e09-910e-e6874dd6b53a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 14 microversion: 2.1 time: 3.251790 Jan 11 14:14:15.511127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 92/196] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:12 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 14 bytes in 3253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:14:15.516623 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-588cdd47-2882-4b36-84b1-3c89e9722ba2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:15.517340 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-588cdd47-2882-4b36-84b1-3c89e9722ba2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:15.524823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-588cdd47-2882-4b36-84b1-3c89e9722ba2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:15.525279 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-588cdd47-2882-4b36-84b1-3c89e9722ba2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:15.526060 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-588cdd47-2882-4b36-84b1-3c89e9722ba2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:15.526487 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-588cdd47-2882-4b36-84b1-3c89e9722ba2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:15.527844 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9f00067b-52f1-4620-ae19-af1623446ef4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 14 microversion: 2.20 time: 3.096554 Jan 11 14:14:15.528676 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 105/197] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:12 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 14 bytes in 3098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:15.660578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-588cdd47-2882-4b36-84b1-3c89e9722ba2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:15.668029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-588cdd47-2882-4b36-84b1-3c89e9722ba2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.155724 Jan 11 14:14:15.668630 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 93/198] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:15 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:16.522427 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c2e6ace0-7761-4200-8934-065ddf564a4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:16.523337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c2e6ace0-7761-4200-8934-065ddf564a4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:16.530681 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c2e6ace0-7761-4200-8934-065ddf564a4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:16.531262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c2e6ace0-7761-4200-8934-065ddf564a4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:16.531917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c2e6ace0-7761-4200-8934-065ddf564a4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:16.532346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c2e6ace0-7761-4200-8934-065ddf564a4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:16.538221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7ba8c10e-50f5-4d5c-9912-c704ee8944f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:16.539118 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7ba8c10e-50f5-4d5c-9912-c704ee8944f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:16.548774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ba8c10e-50f5-4d5c-9912-c704ee8944f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:16.549243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ba8c10e-50f5-4d5c-9912-c704ee8944f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:16.550079 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ba8c10e-50f5-4d5c-9912-c704ee8944f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:16.550512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ba8c10e-50f5-4d5c-9912-c704ee8944f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:16.612785 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c2e6ace0-7761-4200-8934-065ddf564a4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 14 microversion: 2.1 time: 0.094198 Jan 11 14:14:16.613515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 106/199] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:16 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:14:16.648220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7ba8c10e-50f5-4d5c-9912-c704ee8944f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 14 microversion: 2.20 time: 0.113538 Jan 11 14:14:16.648859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 94/200] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:16 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:16.685097 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cfa6fa4e-e9f5-4587-9cc7-05eb6eb6b17e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:16.685816 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cfa6fa4e-e9f5-4587-9cc7-05eb6eb6b17e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:16.692682 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cfa6fa4e-e9f5-4587-9cc7-05eb6eb6b17e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:16.693129 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cfa6fa4e-e9f5-4587-9cc7-05eb6eb6b17e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:16.693894 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cfa6fa4e-e9f5-4587-9cc7-05eb6eb6b17e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:16.694324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cfa6fa4e-e9f5-4587-9cc7-05eb6eb6b17e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:16.820874 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cfa6fa4e-e9f5-4587-9cc7-05eb6eb6b17e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:16.829160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cfa6fa4e-e9f5-4587-9cc7-05eb6eb6b17e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.148430 Jan 11 14:14:16.829724 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 107/201] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:16 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:17.624412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-79eb79c1-d21f-408a-9f3a-529e7c10c5eb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:17.626270 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-79eb79c1-d21f-408a-9f3a-529e7c10c5eb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:17.641860 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79eb79c1-d21f-408a-9f3a-529e7c10c5eb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:17.642307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79eb79c1-d21f-408a-9f3a-529e7c10c5eb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:17.643095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79eb79c1-d21f-408a-9f3a-529e7c10c5eb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:17.643750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79eb79c1-d21f-408a-9f3a-529e7c10c5eb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:17.659801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7a523553-4db6-42ed-8de2-23eb2a64a700 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:17.660783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7a523553-4db6-42ed-8de2-23eb2a64a700 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:17.667236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a523553-4db6-42ed-8de2-23eb2a64a700 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:17.667675 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a523553-4db6-42ed-8de2-23eb2a64a700 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:17.669008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a523553-4db6-42ed-8de2-23eb2a64a700 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:17.669647 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a523553-4db6-42ed-8de2-23eb2a64a700 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:17.742180 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-79eb79c1-d21f-408a-9f3a-529e7c10c5eb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 14 microversion: 2.1 time: 0.121654 Jan 11 14:14:17.742885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 95/202] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:17 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:14:17.759074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7a523553-4db6-42ed-8de2-23eb2a64a700 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 14 microversion: 2.20 time: 0.102959 Jan 11 14:14:17.759728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 108/203] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:17 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:17.847112 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-592fea56-34b0-467b-a0fa-c714b8fb168a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:17.847778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-592fea56-34b0-467b-a0fa-c714b8fb168a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:17.855191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-592fea56-34b0-467b-a0fa-c714b8fb168a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:17.855725 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-592fea56-34b0-467b-a0fa-c714b8fb168a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:17.856506 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-592fea56-34b0-467b-a0fa-c714b8fb168a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:17.856938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-592fea56-34b0-467b-a0fa-c714b8fb168a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:18.004109 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-592fea56-34b0-467b-a0fa-c714b8fb168a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:18.011286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-592fea56-34b0-467b-a0fa-c714b8fb168a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.168550 Jan 11 14:14:18.011872 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 96/204] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:17 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:18.754432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-32fccd89-da23-459a-80ea-f3f363f982d4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:18.756007 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-32fccd89-da23-459a-80ea-f3f363f982d4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:18.762864 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-32fccd89-da23-459a-80ea-f3f363f982d4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:18.763309 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-32fccd89-da23-459a-80ea-f3f363f982d4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:18.764280 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-32fccd89-da23-459a-80ea-f3f363f982d4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:18.764930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-32fccd89-da23-459a-80ea-f3f363f982d4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:18.771306 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3fa72421-3d82-4d22-a8cf-7eb0e758cc75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:18.773063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3fa72421-3d82-4d22-a8cf-7eb0e758cc75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:18.788009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3fa72421-3d82-4d22-a8cf-7eb0e758cc75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:18.788515 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3fa72421-3d82-4d22-a8cf-7eb0e758cc75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:18.789315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3fa72421-3d82-4d22-a8cf-7eb0e758cc75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:18.789755 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3fa72421-3d82-4d22-a8cf-7eb0e758cc75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:18.861520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-32fccd89-da23-459a-80ea-f3f363f982d4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 14 microversion: 2.1 time: 0.110907 Jan 11 14:14:18.863541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 109/205] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:18 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:14:18.904047 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3fa72421-3d82-4d22-a8cf-7eb0e758cc75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 3072 microversion: 2.20 time: 0.134038 Jan 11 14:14:18.904913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 97/206] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:18 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 3072 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:14:19.029194 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a8231c03-bede-48e8-becc-75da4ee4323d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:19.029885 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a8231c03-bede-48e8-becc-75da4ee4323d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:19.043070 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8231c03-bede-48e8-becc-75da4ee4323d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:19.044262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8231c03-bede-48e8-becc-75da4ee4323d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:19.045065 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8231c03-bede-48e8-becc-75da4ee4323d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:19.045496 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8231c03-bede-48e8-becc-75da4ee4323d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:19.260027 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a8231c03-bede-48e8-becc-75da4ee4323d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:19.272514 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a8231c03-bede-48e8-becc-75da4ee4323d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.247772 Jan 11 14:14:19.280753 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 110/207] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:19 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:19.876907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a7cab904-65c3-4095-a5b7-584307a46a20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:19.879642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a7cab904-65c3-4095-a5b7-584307a46a20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:19.891910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a7cab904-65c3-4095-a5b7-584307a46a20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:19.892440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a7cab904-65c3-4095-a5b7-584307a46a20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:19.893466 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a7cab904-65c3-4095-a5b7-584307a46a20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:19.894189 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a7cab904-65c3-4095-a5b7-584307a46a20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:19.921492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1dbccb1c-788c-4743-b528-f52e72cc1c4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:19.925490 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1dbccb1c-788c-4743-b528-f52e72cc1c4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:19.943447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1dbccb1c-788c-4743-b528-f52e72cc1c4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:19.943928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1dbccb1c-788c-4743-b528-f52e72cc1c4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:19.944758 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1dbccb1c-788c-4743-b528-f52e72cc1c4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:19.945169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1dbccb1c-788c-4743-b528-f52e72cc1c4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:23.776481 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a7cab904-65c3-4095-a5b7-584307a46a20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 15064 microversion: 2.1 time: 3.905204 Jan 11 14:14:23.777721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 98/208] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:19 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 15064 bytes in 3909 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:23.783131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-992dd389-8244-4590-ba6f-a38a742fad45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:23.783840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-992dd389-8244-4590-ba6f-a38a742fad45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:23.793808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-992dd389-8244-4590-ba6f-a38a742fad45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:23.794255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-992dd389-8244-4590-ba6f-a38a742fad45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:23.795661 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-992dd389-8244-4590-ba6f-a38a742fad45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:23.796333 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-992dd389-8244-4590-ba6f-a38a742fad45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:23.812116 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1dbccb1c-788c-4743-b528-f52e72cc1c4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 17861 microversion: 2.20 time: 3.899908 Jan 11 14:14:23.813291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 111/209] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:19 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 17861 bytes in 3902 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:24.054597 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-992dd389-8244-4590-ba6f-a38a742fad45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:24.063862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-992dd389-8244-4590-ba6f-a38a742fad45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.284176 Jan 11 14:14:24.064184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 99/210] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:23 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:24.788718 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-46eddc73-6973-4c2f-9ac1-ab96a2b50c69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:24.789971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-46eddc73-6973-4c2f-9ac1-ab96a2b50c69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:24.798154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-46eddc73-6973-4c2f-9ac1-ab96a2b50c69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:24.799145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-46eddc73-6973-4c2f-9ac1-ab96a2b50c69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:24.800310 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-46eddc73-6973-4c2f-9ac1-ab96a2b50c69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:24.801161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-46eddc73-6973-4c2f-9ac1-ab96a2b50c69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:24.825333 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e70c6cb3-6e88-4dac-a19c-b1e6bfbf6b56 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:24.826251 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e70c6cb3-6e88-4dac-a19c-b1e6bfbf6b56 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:24.834858 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e70c6cb3-6e88-4dac-a19c-b1e6bfbf6b56 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:24.835421 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e70c6cb3-6e88-4dac-a19c-b1e6bfbf6b56 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:24.836294 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e70c6cb3-6e88-4dac-a19c-b1e6bfbf6b56 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:24.836972 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e70c6cb3-6e88-4dac-a19c-b1e6bfbf6b56 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:24.917930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-46eddc73-6973-4c2f-9ac1-ab96a2b50c69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 17808 microversion: 2.1 time: 0.132979 Jan 11 14:14:24.921649 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 112/211] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:24 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 17808 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:24.936670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e70c6cb3-6e88-4dac-a19c-b1e6bfbf6b56 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 18827 microversion: 2.20 time: 0.116289 Jan 11 14:14:24.937221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 100/212] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:24 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 18827 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:25.093060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6e79646d-7800-4310-9921-76fb7f0be7d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:25.093777 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6e79646d-7800-4310-9921-76fb7f0be7d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:25.100402 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e79646d-7800-4310-9921-76fb7f0be7d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:25.100846 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e79646d-7800-4310-9921-76fb7f0be7d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:25.108829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e79646d-7800-4310-9921-76fb7f0be7d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:25.109295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e79646d-7800-4310-9921-76fb7f0be7d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:25.296899 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6e79646d-7800-4310-9921-76fb7f0be7d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:25.304285 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6e79646d-7800-4310-9921-76fb7f0be7d3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.227584 Jan 11 14:14:25.304790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 113/213] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:25 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:25.473364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1901775769", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "d319b443-645e-432a-b025-0fae1ca27645"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:25.533935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] validate_networks() for [('d319b443-645e-432a-b025-0fae1ca27645', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:14:25.888410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:14:25.889461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:14:25.890152 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:14:25.890567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:14:25.890938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:14:25.899909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:25.900371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:25.901184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:25.901628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:25.920962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Getting quotas for project 2b10949b6e5a439990bd8563f61eca19. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:14:25.925184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Getting quotas for user 03bd3500319e438693757912c1938a57 and project 2b10949b6e5a439990bd8563f61eca19. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:14:25.930579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ffa74d75-0385-49a0-bd33-cf975010f990 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:25.932224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ffa74d75-0385-49a0-bd33-cf975010f990 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:25.937028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:14:25.939457 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:14:25.940357 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffa74d75-0385-49a0-bd33-cf975010f990 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:25.941071 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffa74d75-0385-49a0-bd33-cf975010f990 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:25.942085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffa74d75-0385-49a0-bd33-cf975010f990 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:25.942723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffa74d75-0385-49a0-bd33-cf975010f990 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:26.001485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4ab78109-be2d-4a8a-883c-8d295cb791a0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532156 Jan 11 14:14:26.002237 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 101/214] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 14:14:26.007375 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-44b5fbac-f445-4f23-8f37-1d6f665697ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:26.008624 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-44b5fbac-f445-4f23-8f37-1d6f665697ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:26.015798 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44b5fbac-f445-4f23-8f37-1d6f665697ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:26.016244 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44b5fbac-f445-4f23-8f37-1d6f665697ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:26.017324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44b5fbac-f445-4f23-8f37-1d6f665697ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:26.017759 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44b5fbac-f445-4f23-8f37-1d6f665697ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:26.056223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ffa74d75-0385-49a0-bd33-cf975010f990 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 17931 microversion: 2.1 time: 0.130358 Jan 11 14:14:26.057236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 114/215] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:25 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 17931 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:26.066964 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7f7cdf25-3661-4496-a1e7-2231698ec587 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:26.082607 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7f7cdf25-3661-4496-a1e7-2231698ec587 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:26.125736 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-44b5fbac-f445-4f23-8f37-1d6f665697ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 20991 microversion: 2.20 time: 0.122390 Jan 11 14:14:26.126394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 102/216] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:26 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 20991 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:26.178936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7f7cdf25-3661-4496-a1e7-2231698ec587 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:26.187032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7f7cdf25-3661-4496-a1e7-2231698ec587 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1219 microversion: 2.1 time: 0.128182 Jan 11 14:14:26.187669 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 115/217] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:26 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:26.325459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7c360408-7a04-488e-84ef-0059dfc9d0e1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:26.326950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7c360408-7a04-488e-84ef-0059dfc9d0e1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:26.337992 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c360408-7a04-488e-84ef-0059dfc9d0e1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:26.338814 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c360408-7a04-488e-84ef-0059dfc9d0e1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:26.340575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c360408-7a04-488e-84ef-0059dfc9d0e1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:26.341197 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c360408-7a04-488e-84ef-0059dfc9d0e1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:26.356462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1481758559", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "7b5e68a5-0493-4fc3-a425-de993e119741"}]}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:26.434665 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] validate_networks() for [('7b5e68a5-0493-4fc3-a425-de993e119741', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:14:26.623073 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7c360408-7a04-488e-84ef-0059dfc9d0e1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:26.636041 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7c360408-7a04-488e-84ef-0059dfc9d0e1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.314659 Jan 11 14:14:26.642286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 103/218] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:26 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:26.962950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:14:26.963443 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:14:26.963923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:14:26.964333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:14:26.964748 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:14:26.973880 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:26.974317 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:26.975130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:26.975593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:26.993228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Getting quotas for project 61ee5ce1ef8d4f0ba4a225c91b7f6d05. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:14:26.997678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Getting quotas for user 5951e83a1eae43f4a8f9b3ebebc23350 and project 61ee5ce1ef8d4f0ba4a225c91b7f6d05. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:14:27.008390 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:14:27.010704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:14:27.058513 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d0923d22-0c32-4e6b-8d50-9801be93c45d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708689 Jan 11 14:14:27.066628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 116/219] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:14:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 14:14:27.070263 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ac2b83e5-3f57-4493-831d-e7937fe650fa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:27.071631 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ac2b83e5-3f57-4493-831d-e7937fe650fa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:27.077685 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7b367353-58dc-42ce-af80-e42d90895217 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:27.078307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7b367353-58dc-42ce-af80-e42d90895217 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:27.079938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac2b83e5-3f57-4493-831d-e7937fe650fa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.080605 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac2b83e5-3f57-4493-831d-e7937fe650fa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.081884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac2b83e5-3f57-4493-831d-e7937fe650fa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.082672 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac2b83e5-3f57-4493-831d-e7937fe650fa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.140609 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7b367353-58dc-42ce-af80-e42d90895217 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:27.147611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7b367353-58dc-42ce-af80-e42d90895217 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1214 microversion: 2.1 time: 0.075216 Jan 11 14:14:27.148180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 117/220] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:27 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:27.154281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-359bb309-8fb9-4385-aca1-61e2a72e3715 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:27.155248 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-359bb309-8fb9-4385-aca1-61e2a72e3715 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:27.162849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-359bb309-8fb9-4385-aca1-61e2a72e3715 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.163301 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-359bb309-8fb9-4385-aca1-61e2a72e3715 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.164155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-359bb309-8fb9-4385-aca1-61e2a72e3715 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.164587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-359bb309-8fb9-4385-aca1-61e2a72e3715 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.201013 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ac2b83e5-3f57-4493-831d-e7937fe650fa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 19893 microversion: 2.1 time: 0.134827 Jan 11 14:14:27.204855 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 104/221] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:27 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 19893 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:27.212211 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-582b9e94-6b8c-4922-b928-154af9e60e82 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:27.213378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-582b9e94-6b8c-4922-b928-154af9e60e82 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:27.224125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-582b9e94-6b8c-4922-b928-154af9e60e82 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.225020 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-582b9e94-6b8c-4922-b928-154af9e60e82 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.226243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-582b9e94-6b8c-4922-b928-154af9e60e82 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.226930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-582b9e94-6b8c-4922-b928-154af9e60e82 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.282463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-359bb309-8fb9-4385-aca1-61e2a72e3715 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 22275 microversion: 2.20 time: 0.131559 Jan 11 14:14:27.283403 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 118/222] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:27 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 22275 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:27.288516 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a8ec4d30-3c03-4f0e-b86c-1fe40fc07878 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:27.289712 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a8ec4d30-3c03-4f0e-b86c-1fe40fc07878 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:27.300674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8ec4d30-3c03-4f0e-b86c-1fe40fc07878 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.301720 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8ec4d30-3c03-4f0e-b86c-1fe40fc07878 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.302783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8ec4d30-3c03-4f0e-b86c-1fe40fc07878 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.303455 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8ec4d30-3c03-4f0e-b86c-1fe40fc07878 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.320831 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-582b9e94-6b8c-4922-b928-154af9e60e82 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:27.328522 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-582b9e94-6b8c-4922-b928-154af9e60e82 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1271 microversion: 2.1 time: 0.122201 Jan 11 14:14:27.334722 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a8ec4d30-3c03-4f0e-b86c-1fe40fc07878 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:14:27.338903 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 105/223] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:27 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:27.444653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a8ec4d30-3c03-4f0e-b86c-1fe40fc07878 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "DELETE /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 204 len: 0 microversion: 2.1 time: 0.159375 Jan 11 14:14:27.445274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 119/224] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:14:27 2022] DELETE /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:14:27.454280 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4cc40f58-4914-400b-942c-5871e9709f4b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:27.460322 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4cc40f58-4914-400b-942c-5871e9709f4b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:27.470480 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4cc40f58-4914-400b-942c-5871e9709f4b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.471135 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4cc40f58-4914-400b-942c-5871e9709f4b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.472291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4cc40f58-4914-400b-942c-5871e9709f4b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.472871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4cc40f58-4914-400b-942c-5871e9709f4b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.650652 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-be0e4e4d-105d-4af9-b76a-afd7a2ce9858 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:27.651354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-be0e4e4d-105d-4af9-b76a-afd7a2ce9858 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:27.661658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be0e4e4d-105d-4af9-b76a-afd7a2ce9858 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.662405 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be0e4e4d-105d-4af9-b76a-afd7a2ce9858 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.663372 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be0e4e4d-105d-4af9-b76a-afd7a2ce9858 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:27.663977 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be0e4e4d-105d-4af9-b76a-afd7a2ce9858 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:27.790952 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4cc40f58-4914-400b-942c-5871e9709f4b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:27.799838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4cc40f58-4914-400b-942c-5871e9709f4b tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1553 microversion: 2.1 time: 0.349377 Jan 11 14:14:27.800421 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 106/225] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:27 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:27.946343 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-be0e4e4d-105d-4af9-b76a-afd7a2ce9858 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:27.954642 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-be0e4e4d-105d-4af9-b76a-afd7a2ce9858 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.308934 Jan 11 14:14:27.955228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 120/226] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:27 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:28.167288 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-640a2ff8-e107-4d21-8613-76bebbdce0b9 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:28.167973 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-640a2ff8-e107-4d21-8613-76bebbdce0b9 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:28.174410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-640a2ff8-e107-4d21-8613-76bebbdce0b9 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.175086 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-640a2ff8-e107-4d21-8613-76bebbdce0b9 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.175968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-640a2ff8-e107-4d21-8613-76bebbdce0b9 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.176440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-640a2ff8-e107-4d21-8613-76bebbdce0b9 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.213171 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2a107e48-fc73-444d-9eca-963915583005 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:28.214385 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2a107e48-fc73-444d-9eca-963915583005 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:28.220935 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a107e48-fc73-444d-9eca-963915583005 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.221539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a107e48-fc73-444d-9eca-963915583005 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.222685 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a107e48-fc73-444d-9eca-963915583005 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.223375 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a107e48-fc73-444d-9eca-963915583005 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.260270 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-640a2ff8-e107-4d21-8613-76bebbdce0b9 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:28.269887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-640a2ff8-e107-4d21-8613-76bebbdce0b9 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1266 microversion: 2.1 time: 0.108110 Jan 11 14:14:28.269887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 107/227] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:28 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:28.302988 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c47218bd-7663-49d0-b235-bb85f6bb0a9c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:28.304280 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c47218bd-7663-49d0-b235-bb85f6bb0a9c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:28.315727 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2a107e48-fc73-444d-9eca-963915583005 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 21733 microversion: 2.1 time: 0.105683 Jan 11 14:14:28.318651 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c47218bd-7663-49d0-b235-bb85f6bb0a9c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.319216 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 121/228] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:28 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 21733 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:28.319618 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c47218bd-7663-49d0-b235-bb85f6bb0a9c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.322382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c47218bd-7663-49d0-b235-bb85f6bb0a9c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.323683 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c47218bd-7663-49d0-b235-bb85f6bb0a9c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.347268 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0663f567-8d79-4ebe-b97b-cfe71047fcc8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:28.347999 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0663f567-8d79-4ebe-b97b-cfe71047fcc8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:28.360092 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0663f567-8d79-4ebe-b97b-cfe71047fcc8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.360711 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0663f567-8d79-4ebe-b97b-cfe71047fcc8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.363429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0663f567-8d79-4ebe-b97b-cfe71047fcc8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.364237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0663f567-8d79-4ebe-b97b-cfe71047fcc8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.518380 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c47218bd-7663-49d0-b235-bb85f6bb0a9c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 23227 microversion: 2.20 time: 0.225413 Jan 11 14:14:28.523645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 108/229] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:28 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 23227 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:28.825166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-638ad99d-f6b8-49cb-b078-21ce4e82a370 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:28.826142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-638ad99d-f6b8-49cb-b078-21ce4e82a370 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:28.832918 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-638ad99d-f6b8-49cb-b078-21ce4e82a370 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.833607 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-638ad99d-f6b8-49cb-b078-21ce4e82a370 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.834523 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-638ad99d-f6b8-49cb-b078-21ce4e82a370 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.834956 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-638ad99d-f6b8-49cb-b078-21ce4e82a370 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.850450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0663f567-8d79-4ebe-b97b-cfe71047fcc8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:28.861463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0663f567-8d79-4ebe-b97b-cfe71047fcc8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1319 microversion: 2.1 time: 0.518988 Jan 11 14:14:28.862038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 122/230] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:28 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:28.973075 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d2e658b3-d57a-4f32-b9dd-9486a99645f1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:28.973075 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d2e658b3-d57a-4f32-b9dd-9486a99645f1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:28.979817 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2e658b3-d57a-4f32-b9dd-9486a99645f1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.980262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2e658b3-d57a-4f32-b9dd-9486a99645f1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:28.981086 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2e658b3-d57a-4f32-b9dd-9486a99645f1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:28.981590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2e658b3-d57a-4f32-b9dd-9486a99645f1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.316816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-638ad99d-f6b8-49cb-b078-21ce4e82a370 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:29.336145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-638ad99d-f6b8-49cb-b078-21ce4e82a370 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1553 microversion: 2.1 time: 0.515869 Jan 11 14:14:29.337595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 109/231] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:28 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1553 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:29.345150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fc0419dc-f962-4c15-93ba-fe2cfbad7927 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:29.345930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fc0419dc-f962-4c15-93ba-fe2cfbad7927 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:29.352864 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc0419dc-f962-4c15-93ba-fe2cfbad7927 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.353481 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc0419dc-f962-4c15-93ba-fe2cfbad7927 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.354788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc0419dc-f962-4c15-93ba-fe2cfbad7927 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.355693 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc0419dc-f962-4c15-93ba-fe2cfbad7927 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.389691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d2e658b3-d57a-4f32-b9dd-9486a99645f1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:29.404721 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d2e658b3-d57a-4f32-b9dd-9486a99645f1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.437788 Jan 11 14:14:29.405538 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 123/232] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:28 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:29.416251 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c1508e52-44bb-4dfb-bab5-0d084fbdbfde tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:29.417389 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c1508e52-44bb-4dfb-bab5-0d084fbdbfde tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:29.424313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c1508e52-44bb-4dfb-bab5-0d084fbdbfde tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.424925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c1508e52-44bb-4dfb-bab5-0d084fbdbfde tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.425725 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c1508e52-44bb-4dfb-bab5-0d084fbdbfde tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.426161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c1508e52-44bb-4dfb-bab5-0d084fbdbfde tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.469958 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fc0419dc-f962-4c15-93ba-fe2cfbad7927 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:29.481228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fc0419dc-f962-4c15-93ba-fe2cfbad7927 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1272 microversion: 2.1 time: 0.141907 Jan 11 14:14:29.482178 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 110/233] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:29 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:29.512491 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c1508e52-44bb-4dfb-bab5-0d084fbdbfde tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 22940 microversion: 2.1 time: 0.102328 Jan 11 14:14:29.517172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 124/234] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:29 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 22940 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:29.533920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-66868b43-1aee-4358-a650-cee473e883c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:29.536087 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-66868b43-1aee-4358-a650-cee473e883c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:29.546500 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-66868b43-1aee-4358-a650-cee473e883c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.547151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-66868b43-1aee-4358-a650-cee473e883c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.548401 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-66868b43-1aee-4358-a650-cee473e883c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.549035 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-66868b43-1aee-4358-a650-cee473e883c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.654284 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-66868b43-1aee-4358-a650-cee473e883c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 23796 microversion: 2.20 time: 0.127664 Jan 11 14:14:29.655042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 111/235] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:29 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 23796 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:29.884620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fac47ff1-e707-4c63-9f87-fe9b8c14234f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:29.887247 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fac47ff1-e707-4c63-9f87-fe9b8c14234f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:29.903364 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fac47ff1-e707-4c63-9f87-fe9b8c14234f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.903854 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fac47ff1-e707-4c63-9f87-fe9b8c14234f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.904809 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fac47ff1-e707-4c63-9f87-fe9b8c14234f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.905409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fac47ff1-e707-4c63-9f87-fe9b8c14234f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.954511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-e6f7e2a2-dcc5-4ce3-942b-dfa84c4d51e1 req-642f022e-9cbd-4fa2-92be-c99c8611f8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f529c1c-6a41-4af2-9b68-66480142d541", "tag": "05f5ded1-fa13-416c-a773-af2edc884f66"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:29.956859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:29.956859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:14:29.969667 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-e6f7e2a2-dcc5-4ce3-942b-dfa84c4d51e1 req-642f022e-9cbd-4fa2-92be-c99c8611f8e4 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:29.970938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-e6f7e2a2-dcc5-4ce3-942b-dfa84c4d51e1 req-642f022e-9cbd-4fa2-92be-c99c8611f8e4 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:29.984600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-e6f7e2a2-dcc5-4ce3-942b-dfa84c4d51e1 req-642f022e-9cbd-4fa2-92be-c99c8611f8e4 service nova] Creating event network-changed:05f5ded1-fa13-416c-a773-af2edc884f66 for instance 3f529c1c-6a41-4af2-9b68-66480142d541 on hv-cinder-82413 Jan 11 14:14:29.990228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-e6f7e2a2-dcc5-4ce3-942b-dfa84c4d51e1 req-642f022e-9cbd-4fa2-92be-c99c8611f8e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042145 Jan 11 14:14:29.990828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 112/236] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:14:30.273290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fac47ff1-e707-4c63-9f87-fe9b8c14234f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:30.284178 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fac47ff1-e707-4c63-9f87-fe9b8c14234f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1319 microversion: 2.1 time: 0.409167 Jan 11 14:14:30.285534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 125/237] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:29 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:30.361058 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-36879f9c-8aee-4024-87dc-2d130d0676a8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:30.362786 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-36879f9c-8aee-4024-87dc-2d130d0676a8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:30.390350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36879f9c-8aee-4024-87dc-2d130d0676a8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:30.392670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36879f9c-8aee-4024-87dc-2d130d0676a8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:30.393799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36879f9c-8aee-4024-87dc-2d130d0676a8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:30.395822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36879f9c-8aee-4024-87dc-2d130d0676a8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:30.424011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-90e7f8b3-f170-4f19-a936-de5d3826ac8c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:30.424829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-90e7f8b3-f170-4f19-a936-de5d3826ac8c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:30.437706 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-90e7f8b3-f170-4f19-a936-de5d3826ac8c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:30.438210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-90e7f8b3-f170-4f19-a936-de5d3826ac8c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:30.439036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-90e7f8b3-f170-4f19-a936-de5d3826ac8c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:30.439985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-90e7f8b3-f170-4f19-a936-de5d3826ac8c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.198665 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-90e7f8b3-f170-4f19-a936-de5d3826ac8c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:31.207862 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-90e7f8b3-f170-4f19-a936-de5d3826ac8c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.789286 Jan 11 14:14:31.209369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 126/238] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:30 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:31.218642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-36879f9c-8aee-4024-87dc-2d130d0676a8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:31.220463 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-36879f9c-8aee-4024-87dc-2d130d0676a8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1553 microversion: 2.1 time: 0.865081 Jan 11 14:14:31.221056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 113/239] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:30 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1553 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:31.224646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-69743837-8e1e-41d9-b882-9fb0276a86fa tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:31.225495 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-69743837-8e1e-41d9-b882-9fb0276a86fa tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:31.232736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69743837-8e1e-41d9-b882-9fb0276a86fa tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.233494 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69743837-8e1e-41d9-b882-9fb0276a86fa tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.234464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69743837-8e1e-41d9-b882-9fb0276a86fa tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.235303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69743837-8e1e-41d9-b882-9fb0276a86fa tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.236618 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d5ee2286-f195-4302-8127-8fe43f72eca7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:31.237549 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d5ee2286-f195-4302-8127-8fe43f72eca7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:31.266980 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5ee2286-f195-4302-8127-8fe43f72eca7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.267427 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5ee2286-f195-4302-8127-8fe43f72eca7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.268259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5ee2286-f195-4302-8127-8fe43f72eca7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.268691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5ee2286-f195-4302-8127-8fe43f72eca7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.380707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d5ee2286-f195-4302-8127-8fe43f72eca7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 23893 microversion: 2.1 time: 0.147455 Jan 11 14:14:31.381643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 114/240] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:31 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 23893 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:31.389852 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ae824a34-17c5-4493-9a47-8d5b5251a5a9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:31.391682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ae824a34-17c5-4493-9a47-8d5b5251a5a9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:31.403214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae824a34-17c5-4493-9a47-8d5b5251a5a9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.405052 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae824a34-17c5-4493-9a47-8d5b5251a5a9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.406193 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae824a34-17c5-4493-9a47-8d5b5251a5a9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.406893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae824a34-17c5-4493-9a47-8d5b5251a5a9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.651305 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-69743837-8e1e-41d9-b882-9fb0276a86fa tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:31.661518 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-69743837-8e1e-41d9-b882-9fb0276a86fa tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.440959 Jan 11 14:14:31.662200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 127/241] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:31 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:31.666556 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8ed40c65-426a-462c-89f3-a2bb5ab629a6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:31.667222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8ed40c65-426a-462c-89f3-a2bb5ab629a6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:31.673210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8ed40c65-426a-462c-89f3-a2bb5ab629a6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.673918 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8ed40c65-426a-462c-89f3-a2bb5ab629a6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.675119 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8ed40c65-426a-462c-89f3-a2bb5ab629a6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.676070 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8ed40c65-426a-462c-89f3-a2bb5ab629a6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.767120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ae824a34-17c5-4493-9a47-8d5b5251a5a9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 25446 microversion: 2.20 time: 0.382620 Jan 11 14:14:31.768355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 115/242] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:31 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 25446 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:31.773281 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-d8faa76a-793f-491b-8dfb-7290b3b200d0 req-a85961da-72eb-4a6e-b3c0-feedd7552928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667829c5-ceaa-492a-8a6f-98dfd8155a4c", "name": "network-vif-deleted", "tag": "c063d65b-930d-449b-91e5-7f64c92f6387"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:31.774771 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:31.774771 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:14:31.782590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-d8faa76a-793f-491b-8dfb-7290b3b200d0 req-a85961da-72eb-4a6e-b3c0-feedd7552928 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:31.783040 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-d8faa76a-793f-491b-8dfb-7290b3b200d0 req-a85961da-72eb-4a6e-b3c0-feedd7552928 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:31.794913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-d8faa76a-793f-491b-8dfb-7290b3b200d0 req-a85961da-72eb-4a6e-b3c0-feedd7552928 service nova] Creating event network-vif-deleted:c063d65b-930d-449b-91e5-7f64c92f6387 for instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c on hv-cinder-82413 Jan 11 14:14:31.803789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-d8faa76a-793f-491b-8dfb-7290b3b200d0 req-a85961da-72eb-4a6e-b3c0-feedd7552928 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033720 Jan 11 14:14:31.804447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 116/243] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:32.021701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-2974751b-652a-4835-b887-68ce44503957 req-5570de24-68ff-4b73-b7fb-0d02d92d5238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d97571e-9535-4d22-a9be-ee6cd65c65ed", "tag": "37a394de-2958-4344-b1a2-0e94b960aece"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:32.023278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:32.023278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:14:32.031583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-2974751b-652a-4835-b887-68ce44503957 req-5570de24-68ff-4b73-b7fb-0d02d92d5238 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.032233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-2974751b-652a-4835-b887-68ce44503957 req-5570de24-68ff-4b73-b7fb-0d02d92d5238 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.044149 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-2974751b-652a-4835-b887-68ce44503957 req-5570de24-68ff-4b73-b7fb-0d02d92d5238 service nova] Creating event network-changed:37a394de-2958-4344-b1a2-0e94b960aece for instance 0d97571e-9535-4d22-a9be-ee6cd65c65ed on hv-cinder-82413 Jan 11 14:14:32.049744 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-2974751b-652a-4835-b887-68ce44503957 req-5570de24-68ff-4b73-b7fb-0d02d92d5238 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032420 Jan 11 14:14:32.050896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 117/244] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:14:32.111843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8ed40c65-426a-462c-89f3-a2bb5ab629a6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:32.127646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8ed40c65-426a-462c-89f3-a2bb5ab629a6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1319 microversion: 2.1 time: 0.463854 Jan 11 14:14:32.128726 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 128/245] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:31 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:32.229896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1234a78b-195a-4773-9b0e-45ece279a89c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:32.238460 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1234a78b-195a-4773-9b0e-45ece279a89c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:32.243913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:32.244805 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:32.255920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1234a78b-195a-4773-9b0e-45ece279a89c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.260324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1234a78b-195a-4773-9b0e-45ece279a89c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.260648 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.261199 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.262339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1234a78b-195a-4773-9b0e-45ece279a89c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.262506 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.262949 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.263279 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1234a78b-195a-4773-9b0e-45ece279a89c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.344824 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.345585 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.346276 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lazy-loading 'fault' on Instance uuid 667829c5-ceaa-492a-8a6f-98dfd8155a4c {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:14:32.472624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd9aef0ef294e2eafd4ab8508d76373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b47db2a2314b9d80eb556d0bae99aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:32.486616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-35b66004-8012-419e-9006-2b7006f04417 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 200 len: 1351 microversion: 2.1 time: 0.251858 Jan 11 14:14:32.487753 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 129/246] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:32 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 1351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:32.501868 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5a2d72f6-c885-4025-908a-c75855e565bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:32.504195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5a2d72f6-c885-4025-908a-c75855e565bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:32.510788 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5a2d72f6-c885-4025-908a-c75855e565bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.511249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5a2d72f6-c885-4025-908a-c75855e565bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.512186 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5a2d72f6-c885-4025-908a-c75855e565bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.512623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5a2d72f6-c885-4025-908a-c75855e565bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.626849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1234a78b-195a-4773-9b0e-45ece279a89c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:32.639583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1234a78b-195a-4773-9b0e-45ece279a89c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.416369 Jan 11 14:14:32.642416 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 118/247] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:32 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:32.643366 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5a2d72f6-c885-4025-908a-c75855e565bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 24757 microversion: 2.1 time: 0.153535 Jan 11 14:14:32.644375 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 130/248] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:32 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 24757 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:32.678714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f9a0f2a2-d07a-4c82-b5d7-19457f4294c4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:32.679328 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f9a0f2a2-d07a-4c82-b5d7-19457f4294c4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:32.687262 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f9a0f2a2-d07a-4c82-b5d7-19457f4294c4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.688115 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f9a0f2a2-d07a-4c82-b5d7-19457f4294c4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.689698 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f9a0f2a2-d07a-4c82-b5d7-19457f4294c4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.690505 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f9a0f2a2-d07a-4c82-b5d7-19457f4294c4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.779204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9f5195fe-0b81-4b6e-8411-b11c531b48b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:32.780670 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9f5195fe-0b81-4b6e-8411-b11c531b48b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:32.787872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f5195fe-0b81-4b6e-8411-b11c531b48b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.788689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f5195fe-0b81-4b6e-8411-b11c531b48b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.789696 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f5195fe-0b81-4b6e-8411-b11c531b48b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:32.790583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f5195fe-0b81-4b6e-8411-b11c531b48b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:32.875742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f9a0f2a2-d07a-4c82-b5d7-19457f4294c4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:32.886446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f9a0f2a2-d07a-4c82-b5d7-19457f4294c4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.211153 Jan 11 14:14:32.887892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 119/249] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:32 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:33.132372 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9f5195fe-0b81-4b6e-8411-b11c531b48b8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 26117 microversion: 2.20 time: 0.357345 Jan 11 14:14:33.133223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 131/250] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:32 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 26117 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:33.145612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-20158d25-177d-4ffd-9039-fa1128aab4bb tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:33.146382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-20158d25-177d-4ffd-9039-fa1128aab4bb tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:33.154006 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-20158d25-177d-4ffd-9039-fa1128aab4bb tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.154542 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-20158d25-177d-4ffd-9039-fa1128aab4bb tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.155409 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-20158d25-177d-4ffd-9039-fa1128aab4bb tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.155950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-20158d25-177d-4ffd-9039-fa1128aab4bb tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.397913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-20158d25-177d-4ffd-9039-fa1128aab4bb tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:33.406170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-20158d25-177d-4ffd-9039-fa1128aab4bb tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1319 microversion: 2.1 time: 0.264818 Jan 11 14:14:33.407006 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 120/251] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:33 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:33.505541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:33.506421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:33.514108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.514691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.515821 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.516262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.531459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] HTTP exception thrown: Instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c could not be found. Jan 11 14:14:33.532107 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Returning 404 to user: Instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:14:33.532970 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-aff287d0-c0a0-4905-bd43-8ab83e441d2f tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 404 len: 111 microversion: 2.1 time: 0.032319 Jan 11 14:14:33.533604 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 132/252] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:33 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:14:33.631749 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:33.632731 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:33.639050 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.639518 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.640308 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.640745 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.653414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] HTTP exception thrown: Instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c could not be found. Jan 11 14:14:33.654003 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Returning 404 to user: Instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:14:33.654824 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d379c18a-993e-4815-acf9-413ad9d0f9ad tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026864 Jan 11 14:14:33.655316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c0474b93-4b15-467e-bf42-1c5d16efa09c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:33.655429 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 121/253] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:14:33 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:14:33.656370 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c0474b93-4b15-467e-bf42-1c5d16efa09c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:33.662566 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5aeb2852-b699-4098-b584-928e1672a324 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:33.663174 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5aeb2852-b699-4098-b584-928e1672a324 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:33.663794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c0474b93-4b15-467e-bf42-1c5d16efa09c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.664249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c0474b93-4b15-467e-bf42-1c5d16efa09c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.665035 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c0474b93-4b15-467e-bf42-1c5d16efa09c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.665531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c0474b93-4b15-467e-bf42-1c5d16efa09c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.670885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5aeb2852-b699-4098-b584-928e1672a324 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.671356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5aeb2852-b699-4098-b584-928e1672a324 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.672181 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5aeb2852-b699-4098-b584-928e1672a324 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.672631 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5aeb2852-b699-4098-b584-928e1672a324 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.773045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c0474b93-4b15-467e-bf42-1c5d16efa09c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 25546 microversion: 2.1 time: 0.120885 Jan 11 14:14:33.773880 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 133/254] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:33 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 25546 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:33.839658 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5aeb2852-b699-4098-b584-928e1672a324 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:33.844955 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5aeb2852-b699-4098-b584-928e1672a324 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.185750 Jan 11 14:14:33.845569 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 122/255] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:33 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:33.905468 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d5b92663-0274-43f3-af2e-965c8d3a0a76 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:33.906183 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d5b92663-0274-43f3-af2e-965c8d3a0a76 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:33.912902 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d5b92663-0274-43f3-af2e-965c8d3a0a76 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.913513 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d5b92663-0274-43f3-af2e-965c8d3a0a76 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:33.914293 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d5b92663-0274-43f3-af2e-965c8d3a0a76 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:33.914750 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d5b92663-0274-43f3-af2e-965c8d3a0a76 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.052168 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d5b92663-0274-43f3-af2e-965c8d3a0a76 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:34.059354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d5b92663-0274-43f3-af2e-965c8d3a0a76 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.158429 Jan 11 14:14:34.059948 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 134/256] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:33 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:34.143887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ae1a6109-2df6-4e15-b0df-3d8e02871b4c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:34.144788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ae1a6109-2df6-4e15-b0df-3d8e02871b4c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:34.150617 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae1a6109-2df6-4e15-b0df-3d8e02871b4c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.151067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae1a6109-2df6-4e15-b0df-3d8e02871b4c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.151902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae1a6109-2df6-4e15-b0df-3d8e02871b4c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.152842 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ae1a6109-2df6-4e15-b0df-3d8e02871b4c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.316169 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ae1a6109-2df6-4e15-b0df-3d8e02871b4c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 26729 microversion: 2.20 time: 0.175807 Jan 11 14:14:34.320076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 123/257] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:34 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 26729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:34.422703 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b6c80658-f602-4c72-b7f0-5b4d2beeb9ab tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:34.423360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b6c80658-f602-4c72-b7f0-5b4d2beeb9ab tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:34.429963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b6c80658-f602-4c72-b7f0-5b4d2beeb9ab tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.430425 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b6c80658-f602-4c72-b7f0-5b4d2beeb9ab tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.431198 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b6c80658-f602-4c72-b7f0-5b4d2beeb9ab tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.431656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b6c80658-f602-4c72-b7f0-5b4d2beeb9ab tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.586334 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b6c80658-f602-4c72-b7f0-5b4d2beeb9ab tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:34.593685 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b6c80658-f602-4c72-b7f0-5b4d2beeb9ab tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1319 microversion: 2.1 time: 0.174819 Jan 11 14:14:34.594421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 135/258] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:34 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:34.785686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f75c3e19-145d-4051-b4ca-181eecbc0bc6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:34.786811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f75c3e19-145d-4051-b4ca-181eecbc0bc6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:34.794270 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f75c3e19-145d-4051-b4ca-181eecbc0bc6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.794811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f75c3e19-145d-4051-b4ca-181eecbc0bc6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.795725 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f75c3e19-145d-4051-b4ca-181eecbc0bc6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.796227 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f75c3e19-145d-4051-b4ca-181eecbc0bc6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.860708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:34.863001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:34.870433 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.871687 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.872604 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.873233 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.887345 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f75c3e19-145d-4051-b4ca-181eecbc0bc6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 26277 microversion: 2.1 time: 0.105155 Jan 11 14:14:34.888368 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 124/259] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:34 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 26277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:34.894664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-57a33e77-08a8-4e9e-8b49-d8c6049a9db1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:34.895196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] HTTP exception thrown: Instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c could not be found. Jan 11 14:14:34.895950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-57a33e77-08a8-4e9e-8b49-d8c6049a9db1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:34.896798 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Returning 404 to user: Instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:14:34.898532 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-93406dd8-63c5-4809-acb7-4ccda5c05ac8 tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "DELETE /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 404 len: 111 microversion: 2.1 time: 0.045602 Jan 11 14:14:34.903991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 136/260] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:14:34 2022] DELETE /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 14:14:34.908883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-57a33e77-08a8-4e9e-8b49-d8c6049a9db1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.909346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-57a33e77-08a8-4e9e-8b49-d8c6049a9db1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.910435 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-57a33e77-08a8-4e9e-8b49-d8c6049a9db1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.911563 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:34.912029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-57a33e77-08a8-4e9e-8b49-d8c6049a9db1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.912796 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] [instance: 667829c5-ceaa-492a-8a6f-98dfd8155a4c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:34.922362 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.923224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.924197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:34.924972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:34.942004 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] HTTP exception thrown: Instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c could not be found. Jan 11 14:14:34.942611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] Returning 404 to user: Instance 667829c5-ceaa-492a-8a6f-98dfd8155a4c could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:14:34.943439 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9ed1cfef-4ec4-40da-ae95-3c4561b902fc tempest-DeleteServersTestJSON-1869483102 tempest-DeleteServersTestJSON-1869483102-project] 10.222.0.49 "GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c" status: 404 len: 111 microversion: 2.1 time: 0.036808 Jan 11 14:14:34.944679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 137/261] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:34 2022] GET /compute/v2.1/servers/667829c5-ceaa-492a-8a6f-98dfd8155a4c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:14:35.076553 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5588349e-1a9f-4a13-a04f-a15c62bcc436 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:35.077620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5588349e-1a9f-4a13-a04f-a15c62bcc436 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:35.085831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5588349e-1a9f-4a13-a04f-a15c62bcc436 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:35.086609 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5588349e-1a9f-4a13-a04f-a15c62bcc436 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:35.088425 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5588349e-1a9f-4a13-a04f-a15c62bcc436 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:35.089162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5588349e-1a9f-4a13-a04f-a15c62bcc436 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:35.246884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-57a33e77-08a8-4e9e-8b49-d8c6049a9db1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:35.255675 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-57a33e77-08a8-4e9e-8b49-d8c6049a9db1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.365899 Jan 11 14:14:35.256314 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 125/262] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:34 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:35.330887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-08a453f9-d067-4c87-ae48-7de73ff28f90 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:35.333205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-08a453f9-d067-4c87-ae48-7de73ff28f90 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:35.341553 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08a453f9-d067-4c87-ae48-7de73ff28f90 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:35.342256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08a453f9-d067-4c87-ae48-7de73ff28f90 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:35.343253 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08a453f9-d067-4c87-ae48-7de73ff28f90 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:35.343898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08a453f9-d067-4c87-ae48-7de73ff28f90 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:35.358803 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5588349e-1a9f-4a13-a04f-a15c62bcc436 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:35.366564 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5588349e-1a9f-4a13-a04f-a15c62bcc436 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.294326 Jan 11 14:14:35.367137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 138/263] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:35 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:35.498364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-08a453f9-d067-4c87-ae48-7de73ff28f90 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 27310 microversion: 2.20 time: 0.172825 Jan 11 14:14:35.499095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 126/264] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:35 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 27310 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:35.615337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d580d49a-d3a5-4196-b9e3-60cc9e91bb53 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:35.619101 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d580d49a-d3a5-4196-b9e3-60cc9e91bb53 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:35.627306 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d580d49a-d3a5-4196-b9e3-60cc9e91bb53 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:35.627971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d580d49a-d3a5-4196-b9e3-60cc9e91bb53 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:35.628768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d580d49a-d3a5-4196-b9e3-60cc9e91bb53 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:35.629285 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d580d49a-d3a5-4196-b9e3-60cc9e91bb53 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:35.808099 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d580d49a-d3a5-4196-b9e3-60cc9e91bb53 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:35.818375 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d580d49a-d3a5-4196-b9e3-60cc9e91bb53 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1319 microversion: 2.1 time: 0.211637 Jan 11 14:14:35.819121 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 139/265] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:35 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:35.900527 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7128769d-c7a9-4b18-a05c-c5df41cd06e5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:35.901565 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7128769d-c7a9-4b18-a05c-c5df41cd06e5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:35.909706 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7128769d-c7a9-4b18-a05c-c5df41cd06e5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:35.910734 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7128769d-c7a9-4b18-a05c-c5df41cd06e5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:35.911785 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7128769d-c7a9-4b18-a05c-c5df41cd06e5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:35.912462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7128769d-c7a9-4b18-a05c-c5df41cd06e5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:36.006643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7128769d-c7a9-4b18-a05c-c5df41cd06e5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 27043 microversion: 2.1 time: 0.110321 Jan 11 14:14:36.008876 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 127/266] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:35 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 27043 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:36.275416 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c8e20a1c-6fe3-4c2e-bb76-bcf271bbfd40 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:36.276752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c8e20a1c-6fe3-4c2e-bb76-bcf271bbfd40 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:36.286571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8e20a1c-6fe3-4c2e-bb76-bcf271bbfd40 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:36.287624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8e20a1c-6fe3-4c2e-bb76-bcf271bbfd40 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:36.288369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8e20a1c-6fe3-4c2e-bb76-bcf271bbfd40 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:36.289314 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8e20a1c-6fe3-4c2e-bb76-bcf271bbfd40 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:36.384410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a12530d6-e2ef-42b8-bdab-3f3243485df8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:36.385676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a12530d6-e2ef-42b8-bdab-3f3243485df8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:36.396819 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a12530d6-e2ef-42b8-bdab-3f3243485df8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:36.397275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a12530d6-e2ef-42b8-bdab-3f3243485df8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:36.398119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a12530d6-e2ef-42b8-bdab-3f3243485df8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:36.398482 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a12530d6-e2ef-42b8-bdab-3f3243485df8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:36.479399 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c8e20a1c-6fe3-4c2e-bb76-bcf271bbfd40 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:36.487682 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c8e20a1c-6fe3-4c2e-bb76-bcf271bbfd40 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.217046 Jan 11 14:14:36.498290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 140/267] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:36 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:36.512604 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ef939a2b-0655-401c-9437-5ee1b7deafbe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:36.513619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ef939a2b-0655-401c-9437-5ee1b7deafbe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:36.519871 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ef939a2b-0655-401c-9437-5ee1b7deafbe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:36.520665 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ef939a2b-0655-401c-9437-5ee1b7deafbe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:36.521855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ef939a2b-0655-401c-9437-5ee1b7deafbe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:36.522586 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ef939a2b-0655-401c-9437-5ee1b7deafbe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:36.696743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ef939a2b-0655-401c-9437-5ee1b7deafbe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 27603 microversion: 2.20 time: 0.190175 Jan 11 14:14:36.705118 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 141/268] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:36 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 27603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:36.786625 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a12530d6-e2ef-42b8-bdab-3f3243485df8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:36.796499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a12530d6-e2ef-42b8-bdab-3f3243485df8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.416370 Jan 11 14:14:36.797518 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 128/269] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:36 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:36.839982 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-514bdbd2-797d-4122-b1f2-94dd20a6f872 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:36.840825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-514bdbd2-797d-4122-b1f2-94dd20a6f872 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:36.868696 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-514bdbd2-797d-4122-b1f2-94dd20a6f872 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:36.869398 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-514bdbd2-797d-4122-b1f2-94dd20a6f872 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:36.870916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-514bdbd2-797d-4122-b1f2-94dd20a6f872 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:36.871569 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-514bdbd2-797d-4122-b1f2-94dd20a6f872 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.019045 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-bf64fd08-36c2-45fe-b19a-c5bd60eccf40 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:37.020842 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-bf64fd08-36c2-45fe-b19a-c5bd60eccf40 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:37.028432 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bf64fd08-36c2-45fe-b19a-c5bd60eccf40 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.029331 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bf64fd08-36c2-45fe-b19a-c5bd60eccf40 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.030535 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bf64fd08-36c2-45fe-b19a-c5bd60eccf40 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.031340 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bf64fd08-36c2-45fe-b19a-c5bd60eccf40 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.056955 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-514bdbd2-797d-4122-b1f2-94dd20a6f872 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:37.072068 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-514bdbd2-797d-4122-b1f2-94dd20a6f872 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1319 microversion: 2.1 time: 0.239386 Jan 11 14:14:37.073900 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 142/270] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:36 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:37.146129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-bf64fd08-36c2-45fe-b19a-c5bd60eccf40 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 27549 microversion: 2.1 time: 0.130358 Jan 11 14:14:37.147607 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 129/271] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:37 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 27549 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:37.292884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-430ad9bb-f3db-4484-81f6-4dcf509e0933 req-75085f07-9914-43b1-9cef-0708b593f8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f529c1c-6a41-4af2-9b68-66480142d541", "name": "network-vif-plugged", "status": "completed", "tag": "05f5ded1-fa13-416c-a773-af2edc884f66"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:37.294411 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:37.294411 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:14:37.321444 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-430ad9bb-f3db-4484-81f6-4dcf509e0933 req-75085f07-9914-43b1-9cef-0708b593f8aa service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.322221 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-430ad9bb-f3db-4484-81f6-4dcf509e0933 req-75085f07-9914-43b1-9cef-0708b593f8aa service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.359621 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-430ad9bb-f3db-4484-81f6-4dcf509e0933 req-75085f07-9914-43b1-9cef-0708b593f8aa service nova] Creating event network-vif-plugged:05f5ded1-fa13-416c-a773-af2edc884f66 for instance 3f529c1c-6a41-4af2-9b68-66480142d541 on hv-cinder-82413 Jan 11 14:14:37.365872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-430ad9bb-f3db-4484-81f6-4dcf509e0933 req-75085f07-9914-43b1-9cef-0708b593f8aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076024 Jan 11 14:14:37.366739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 143/272] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:37.506107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f99ca797-8b01-462c-9f26-8bbb548ee9bc tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:37.506801 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f99ca797-8b01-462c-9f26-8bbb548ee9bc tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:37.517349 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f99ca797-8b01-462c-9f26-8bbb548ee9bc tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.517802 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f99ca797-8b01-462c-9f26-8bbb548ee9bc tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.522530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f99ca797-8b01-462c-9f26-8bbb548ee9bc tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.523453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f99ca797-8b01-462c-9f26-8bbb548ee9bc tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.716112 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bb9f42b7-057e-4f07-acda-8670c9e4093d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:37.717285 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bb9f42b7-057e-4f07-acda-8670c9e4093d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:37.726962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bb9f42b7-057e-4f07-acda-8670c9e4093d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.728039 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bb9f42b7-057e-4f07-acda-8670c9e4093d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.729163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bb9f42b7-057e-4f07-acda-8670c9e4093d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.729593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bb9f42b7-057e-4f07-acda-8670c9e4093d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.825957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bb9f42b7-057e-4f07-acda-8670c9e4093d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 27893 microversion: 2.20 time: 0.113578 Jan 11 14:14:37.826811 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 144/273] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:37 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 27893 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:37.839430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f9c09d81-6d1e-460e-ad4a-1b8f895cf064 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:37.844496 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f9c09d81-6d1e-460e-ad4a-1b8f895cf064 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:37.868440 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f9c09d81-6d1e-460e-ad4a-1b8f895cf064 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.870580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f9c09d81-6d1e-460e-ad4a-1b8f895cf064 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.872497 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f9c09d81-6d1e-460e-ad4a-1b8f895cf064 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:37.874385 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f9c09d81-6d1e-460e-ad4a-1b8f895cf064 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:37.878475 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f99ca797-8b01-462c-9f26-8bbb548ee9bc tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:37.892926 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f99ca797-8b01-462c-9f26-8bbb548ee9bc tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.391652 Jan 11 14:14:37.894047 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 130/274] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:37 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:38.089741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b2aa8265-32ee-4b22-8c1b-c1397bddce13 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:38.091046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b2aa8265-32ee-4b22-8c1b-c1397bddce13 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:38.098300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2aa8265-32ee-4b22-8c1b-c1397bddce13 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:38.098708 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2aa8265-32ee-4b22-8c1b-c1397bddce13 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:38.099714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2aa8265-32ee-4b22-8c1b-c1397bddce13 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:38.102412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2aa8265-32ee-4b22-8c1b-c1397bddce13 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:38.103668 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f9c09d81-6d1e-460e-ad4a-1b8f895cf064 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:38.124534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f9c09d81-6d1e-460e-ad4a-1b8f895cf064 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.296340 Jan 11 14:14:38.125407 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 145/275] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:37 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:38.158607 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6c64888a-aaca-4e36-a1b7-5ad690363f74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:38.159699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6c64888a-aaca-4e36-a1b7-5ad690363f74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:38.166739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c64888a-aaca-4e36-a1b7-5ad690363f74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:38.167229 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c64888a-aaca-4e36-a1b7-5ad690363f74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:38.168646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c64888a-aaca-4e36-a1b7-5ad690363f74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:38.169936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c64888a-aaca-4e36-a1b7-5ad690363f74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:38.262537 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6c64888a-aaca-4e36-a1b7-5ad690363f74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 27713 microversion: 2.1 time: 0.107161 Jan 11 14:14:38.263188 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 146/276] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:38 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 27713 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:38.286122 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b2aa8265-32ee-4b22-8c1b-c1397bddce13 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:38.294391 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b2aa8265-32ee-4b22-8c1b-c1397bddce13 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1319 microversion: 2.1 time: 0.208449 Jan 11 14:14:38.294974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 131/277] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:38 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:38.838797 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3794918c-b93b-4a90-a731-7626bb5e55ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:38.840122 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3794918c-b93b-4a90-a731-7626bb5e55ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:38.846582 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3794918c-b93b-4a90-a731-7626bb5e55ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:38.847035 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3794918c-b93b-4a90-a731-7626bb5e55ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:38.847847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3794918c-b93b-4a90-a731-7626bb5e55ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:38.848433 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3794918c-b93b-4a90-a731-7626bb5e55ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:38.980936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-140456324", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "60123190-3a8f-4b75-b7ad-1e70cf2044c8"}]}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:39.019142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3794918c-b93b-4a90-a731-7626bb5e55ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 27959 microversion: 2.20 time: 0.184639 Jan 11 14:14:39.019839 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 132/278] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:38 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 27959 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:39.027550 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-79587bef-3053-4ddd-951f-2bec23ded712 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:39.028236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-79587bef-3053-4ddd-951f-2bec23ded712 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:39.036736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] validate_networks() for [('60123190-3a8f-4b75-b7ad-1e70cf2044c8', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:14:39.037859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79587bef-3053-4ddd-951f-2bec23ded712 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.038316 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79587bef-3053-4ddd-951f-2bec23ded712 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.039111 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79587bef-3053-4ddd-951f-2bec23ded712 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.039569 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79587bef-3053-4ddd-951f-2bec23ded712 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.343245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-79587bef-3053-4ddd-951f-2bec23ded712 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:39.352963 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-79587bef-3053-4ddd-951f-2bec23ded712 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.331961 Jan 11 14:14:39.362218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 133/279] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:39 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:39.362218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-619511d1-4f60-4edc-9f53-86c8e1a798cf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:39.362218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-619511d1-4f60-4edc-9f53-86c8e1a798cf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:39.365104 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-619511d1-4f60-4edc-9f53-86c8e1a798cf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.365551 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-619511d1-4f60-4edc-9f53-86c8e1a798cf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.366324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-619511d1-4f60-4edc-9f53-86c8e1a798cf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.366749 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-619511d1-4f60-4edc-9f53-86c8e1a798cf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.674661 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-619511d1-4f60-4edc-9f53-86c8e1a798cf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:39.688372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-619511d1-4f60-4edc-9f53-86c8e1a798cf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.329878 Jan 11 14:14:39.694072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 134/280] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:39 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:39.700040 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cae0f41d-5138-4770-85f7-7b91f38493e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:39.700968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cae0f41d-5138-4770-85f7-7b91f38493e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:39.707202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cae0f41d-5138-4770-85f7-7b91f38493e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.707724 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cae0f41d-5138-4770-85f7-7b91f38493e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.708567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cae0f41d-5138-4770-85f7-7b91f38493e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.709032 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cae0f41d-5138-4770-85f7-7b91f38493e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.731603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:14:39.731603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:14:39.731603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:14:39.731603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:14:39.731955 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:14:39.748234 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.748772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.750969 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.751664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.771564 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Getting quotas for project b02bf5f593a54c658a76fff0246febf4. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:14:39.776794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Getting quotas for user 23f705ed82e441229edd5a48b3797b32 and project b02bf5f593a54c658a76fff0246febf4. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:14:39.794884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:14:39.797659 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:14:39.815376 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cae0f41d-5138-4770-85f7-7b91f38493e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28039 microversion: 2.1 time: 0.119735 Jan 11 14:14:39.817214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 135/281] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:39 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28039 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:39.830421 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3fb99f4f-bb2d-4d42-b57b-416d6e2b6d30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:39.831147 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3fb99f4f-bb2d-4d42-b57b-416d6e2b6d30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:39.840702 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3fb99f4f-bb2d-4d42-b57b-416d6e2b6d30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.841159 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3fb99f4f-bb2d-4d42-b57b-416d6e2b6d30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.842082 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3fb99f4f-bb2d-4d42-b57b-416d6e2b6d30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:39.842518 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3fb99f4f-bb2d-4d42-b57b-416d6e2b6d30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:39.885323 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c353ceeb-2785-433f-994b-504bbc80a3b4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.148239 Jan 11 14:14:39.893370 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 147/282] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 14:14:39.897945 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c0786454-1492-493e-8840-13d19c649311 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:39.899432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c0786454-1492-493e-8840-13d19c649311 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:40.006252 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c0786454-1492-493e-8840-13d19c649311 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:40.014162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c0786454-1492-493e-8840-13d19c649311 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1217 microversion: 2.1 time: 0.119736 Jan 11 14:14:40.014715 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 148/283] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:39 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:40.031830 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-87d74483-9986-4983-b540-44a5f0ba3dd7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:40.033167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-87d74483-9986-4983-b540-44a5f0ba3dd7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:40.043162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-87d74483-9986-4983-b540-44a5f0ba3dd7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:40.043637 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-87d74483-9986-4983-b540-44a5f0ba3dd7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:40.044428 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-87d74483-9986-4983-b540-44a5f0ba3dd7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:40.044859 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-87d74483-9986-4983-b540-44a5f0ba3dd7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:40.073498 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3fb99f4f-bb2d-4d42-b57b-416d6e2b6d30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:40.088937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3fb99f4f-bb2d-4d42-b57b-416d6e2b6d30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1509 microversion: 2.1 time: 0.263899 Jan 11 14:14:40.090496 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 136/284] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:39 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:40.151726 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-87d74483-9986-4983-b540-44a5f0ba3dd7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.123319 Jan 11 14:14:40.154130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 149/285] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:40 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:40.370572 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-263a5b0f-0e73-4fa6-bdaf-5da943f64dc2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:40.372850 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-263a5b0f-0e73-4fa6-bdaf-5da943f64dc2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:40.382669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-263a5b0f-0e73-4fa6-bdaf-5da943f64dc2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:40.383463 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-263a5b0f-0e73-4fa6-bdaf-5da943f64dc2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:40.385293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-263a5b0f-0e73-4fa6-bdaf-5da943f64dc2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:40.385937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-263a5b0f-0e73-4fa6-bdaf-5da943f64dc2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:40.633155 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-263a5b0f-0e73-4fa6-bdaf-5da943f64dc2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:40.647775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-263a5b0f-0e73-4fa6-bdaf-5da943f64dc2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.280709 Jan 11 14:14:40.648378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 137/286] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:40 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:40.701378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-34ff9ebf-177e-41df-8541-9a35bc6cb57d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:40.702076 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-34ff9ebf-177e-41df-8541-9a35bc6cb57d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:40.713584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34ff9ebf-177e-41df-8541-9a35bc6cb57d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:40.715367 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34ff9ebf-177e-41df-8541-9a35bc6cb57d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:40.716693 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34ff9ebf-177e-41df-8541-9a35bc6cb57d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:40.718885 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34ff9ebf-177e-41df-8541-9a35bc6cb57d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:40.834615 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8ff13717-639d-46ca-94f7-ded38e097a2b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:40.835637 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8ff13717-639d-46ca-94f7-ded38e097a2b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:40.842715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ff13717-639d-46ca-94f7-ded38e097a2b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:40.844663 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ff13717-639d-46ca-94f7-ded38e097a2b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:40.846374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ff13717-639d-46ca-94f7-ded38e097a2b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:40.847467 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ff13717-639d-46ca-94f7-ded38e097a2b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:40.898288 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-34ff9ebf-177e-41df-8541-9a35bc6cb57d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:40.906329 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-34ff9ebf-177e-41df-8541-9a35bc6cb57d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.209743 Jan 11 14:14:40.915893 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 150/287] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:40 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:40.941627 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8ff13717-639d-46ca-94f7-ded38e097a2b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.116162 Jan 11 14:14:40.942721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 138/288] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:40 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:41.039169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-037f9f2a-1ac4-499b-8125-f8cd283dc874 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:41.043338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-037f9f2a-1ac4-499b-8125-f8cd283dc874 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:41.051146 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-037f9f2a-1ac4-499b-8125-f8cd283dc874 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.051866 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-037f9f2a-1ac4-499b-8125-f8cd283dc874 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.053917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-037f9f2a-1ac4-499b-8125-f8cd283dc874 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.054567 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-037f9f2a-1ac4-499b-8125-f8cd283dc874 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.168980 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-45fd48ce-2080-43f5-9d76-f95a22814e5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:41.176044 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-45fd48ce-2080-43f5-9d76-f95a22814e5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:41.182787 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-037f9f2a-1ac4-499b-8125-f8cd283dc874 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:41.194102 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-037f9f2a-1ac4-499b-8125-f8cd283dc874 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1269 microversion: 2.1 time: 0.163422 Jan 11 14:14:41.194672 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 151/289] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:41 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:41.200634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-d7bbb15a-28c7-42e8-92af-b3d86c446c4b req-190bdde1-69fb-46c6-a6fe-049065b7a6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d97571e-9535-4d22-a9be-ee6cd65c65ed", "name": "network-vif-plugged", "status": "completed", "tag": "37a394de-2958-4344-b1a2-0e94b960aece"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:41.202161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:41.202161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:14:41.214269 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-45fd48ce-2080-43f5-9d76-f95a22814e5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.217160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-45fd48ce-2080-43f5-9d76-f95a22814e5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.218265 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-45fd48ce-2080-43f5-9d76-f95a22814e5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.220336 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-45fd48ce-2080-43f5-9d76-f95a22814e5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.222998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-d7bbb15a-28c7-42e8-92af-b3d86c446c4b req-190bdde1-69fb-46c6-a6fe-049065b7a6b8 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.223623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-d7bbb15a-28c7-42e8-92af-b3d86c446c4b req-190bdde1-69fb-46c6-a6fe-049065b7a6b8 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.238801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-d7bbb15a-28c7-42e8-92af-b3d86c446c4b req-190bdde1-69fb-46c6-a6fe-049065b7a6b8 service nova] Creating event network-vif-plugged:37a394de-2958-4344-b1a2-0e94b960aece for instance 0d97571e-9535-4d22-a9be-ee6cd65c65ed on hv-cinder-82413 Jan 11 14:14:41.254631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-d7bbb15a-28c7-42e8-92af-b3d86c446c4b req-190bdde1-69fb-46c6-a6fe-049065b7a6b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058718 Jan 11 14:14:41.255225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 152/290] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:41.366583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-45fd48ce-2080-43f5-9d76-f95a22814e5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.205388 Jan 11 14:14:41.367589 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 139/291] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:41 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:41.666782 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c026b385-2be3-4f1e-b925-779524b2daf8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:41.667485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c026b385-2be3-4f1e-b925-779524b2daf8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:41.674534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c026b385-2be3-4f1e-b925-779524b2daf8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.674985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c026b385-2be3-4f1e-b925-779524b2daf8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.675840 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c026b385-2be3-4f1e-b925-779524b2daf8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.676214 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c026b385-2be3-4f1e-b925-779524b2daf8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.923404 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c8ea7b73-6703-459a-a528-8bea87e2a739 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:41.924223 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c8ea7b73-6703-459a-a528-8bea87e2a739 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:41.924463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c026b385-2be3-4f1e-b925-779524b2daf8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:41.933485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c8ea7b73-6703-459a-a528-8bea87e2a739 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.936109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c026b385-2be3-4f1e-b925-779524b2daf8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.273427 Jan 11 14:14:41.936704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 153/292] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:41 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:41.937849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c8ea7b73-6703-459a-a528-8bea87e2a739 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.939637 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c8ea7b73-6703-459a-a528-8bea87e2a739 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.942916 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c8ea7b73-6703-459a-a528-8bea87e2a739 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.957448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-70aa6f69-1ce8-4722-bd08-d3578286fc45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:41.959050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-70aa6f69-1ce8-4722-bd08-d3578286fc45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:41.966030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70aa6f69-1ce8-4722-bd08-d3578286fc45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.966727 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70aa6f69-1ce8-4722-bd08-d3578286fc45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:41.968141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70aa6f69-1ce8-4722-bd08-d3578286fc45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:41.968808 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70aa6f69-1ce8-4722-bd08-d3578286fc45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:42.048154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-70aa6f69-1ce8-4722-bd08-d3578286fc45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.094051 Jan 11 14:14:42.049193 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 154/293] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:41 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:42.214327 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c8ea7b73-6703-459a-a528-8bea87e2a739 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:42.217130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3fab7c6f-b48a-4781-a134-acc5fecd1aec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:42.218205 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3fab7c6f-b48a-4781-a134-acc5fecd1aec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:42.225879 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c8ea7b73-6703-459a-a528-8bea87e2a739 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.306304 Jan 11 14:14:42.227315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 140/294] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:41 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:42.228747 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3fab7c6f-b48a-4781-a134-acc5fecd1aec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:42.232285 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3fab7c6f-b48a-4781-a134-acc5fecd1aec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:42.233873 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3fab7c6f-b48a-4781-a134-acc5fecd1aec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:42.234477 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3fab7c6f-b48a-4781-a134-acc5fecd1aec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:42.378559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4804b8f5-fe39-488b-8aee-0e2411c5aecb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:42.379828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4804b8f5-fe39-488b-8aee-0e2411c5aecb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:42.386428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4804b8f5-fe39-488b-8aee-0e2411c5aecb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:42.387173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4804b8f5-fe39-488b-8aee-0e2411c5aecb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:42.388196 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4804b8f5-fe39-488b-8aee-0e2411c5aecb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:42.388807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4804b8f5-fe39-488b-8aee-0e2411c5aecb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:42.477641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4804b8f5-fe39-488b-8aee-0e2411c5aecb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.102760 Jan 11 14:14:42.478491 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 141/295] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:42 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:42.639817 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3fab7c6f-b48a-4781-a134-acc5fecd1aec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:42.654736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3fab7c6f-b48a-4781-a134-acc5fecd1aec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.446363 Jan 11 14:14:42.659554 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 155/296] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:42 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:42.956924 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-82466987-8fcb-451b-ab57-db6ce302def1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:42.959307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-82466987-8fcb-451b-ab57-db6ce302def1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:42.968911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-82466987-8fcb-451b-ab57-db6ce302def1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:42.969443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-82466987-8fcb-451b-ab57-db6ce302def1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:42.970906 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-82466987-8fcb-451b-ab57-db6ce302def1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:42.971927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-82466987-8fcb-451b-ab57-db6ce302def1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.061278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8c2a5b74-5db1-464c-a0c0-94dc48e432a5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:43.062534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8c2a5b74-5db1-464c-a0c0-94dc48e432a5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:43.069969 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8c2a5b74-5db1-464c-a0c0-94dc48e432a5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.071101 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8c2a5b74-5db1-464c-a0c0-94dc48e432a5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.072067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8c2a5b74-5db1-464c-a0c0-94dc48e432a5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.072524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8c2a5b74-5db1-464c-a0c0-94dc48e432a5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.220303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8c2a5b74-5db1-464c-a0c0-94dc48e432a5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.163971 Jan 11 14:14:43.224883 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 156/297] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:43 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:43.246710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7b8dbe5c-14ef-4bf0-a6c7-f8680a1e2caf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:43.255229 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7b8dbe5c-14ef-4bf0-a6c7-f8680a1e2caf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:43.263520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b8dbe5c-14ef-4bf0-a6c7-f8680a1e2caf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.264195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b8dbe5c-14ef-4bf0-a6c7-f8680a1e2caf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.265303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b8dbe5c-14ef-4bf0-a6c7-f8680a1e2caf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.265886 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b8dbe5c-14ef-4bf0-a6c7-f8680a1e2caf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.613566 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-82466987-8fcb-451b-ab57-db6ce302def1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:43.626652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-82466987-8fcb-451b-ab57-db6ce302def1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.675488 Jan 11 14:14:43.627234 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 142/298] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:42 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:43.645974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fb18433f-39b5-4031-b595-f1d2b779af5f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:43.646150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7b8dbe5c-14ef-4bf0-a6c7-f8680a1e2caf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:43.648220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fb18433f-39b5-4031-b595-f1d2b779af5f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:43.658836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7b8dbe5c-14ef-4bf0-a6c7-f8680a1e2caf tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1314 microversion: 2.1 time: 0.417558 Jan 11 14:14:43.659436 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 157/299] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:43 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:43.669214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fb18433f-39b5-4031-b595-f1d2b779af5f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.669214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fb18433f-39b5-4031-b595-f1d2b779af5f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.669214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fb18433f-39b5-4031-b595-f1d2b779af5f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.669214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fb18433f-39b5-4031-b595-f1d2b779af5f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.679917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-73f2c099-692c-4497-b70f-09e49439f328 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:43.680545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-73f2c099-692c-4497-b70f-09e49439f328 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:43.716655 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-73f2c099-692c-4497-b70f-09e49439f328 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.717134 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-73f2c099-692c-4497-b70f-09e49439f328 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.718163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-73f2c099-692c-4497-b70f-09e49439f328 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.718632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-73f2c099-692c-4497-b70f-09e49439f328 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:43.778728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fb18433f-39b5-4031-b595-f1d2b779af5f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.144060 Jan 11 14:14:43.780319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 143/300] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:43 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:43.953584 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-f0f82840-eb30-4535-9eb4-16cf94c85f97 req-3c50b942-6d17-496f-8b19-71ee81131c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe790a9d-f25c-4f0c-852d-3155d29520c0", "tag": "e6f3dc3e-4f1c-4201-b63f-f6a4b7ffd872"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:43.957362 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:43.957362 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:14:43.970136 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-f0f82840-eb30-4535-9eb4-16cf94c85f97 req-3c50b942-6d17-496f-8b19-71ee81131c2b service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:43.970708 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-f0f82840-eb30-4535-9eb4-16cf94c85f97 req-3c50b942-6d17-496f-8b19-71ee81131c2b service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:44.009440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-f0f82840-eb30-4535-9eb4-16cf94c85f97 req-3c50b942-6d17-496f-8b19-71ee81131c2b service nova] Creating event network-changed:e6f3dc3e-4f1c-4201-b63f-f6a4b7ffd872 for instance fe790a9d-f25c-4f0c-852d-3155d29520c0 on hv-cinder-82413 Jan 11 14:14:44.012544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-73f2c099-692c-4497-b70f-09e49439f328 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:44.017057 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-f0f82840-eb30-4535-9eb4-16cf94c85f97 req-3c50b942-6d17-496f-8b19-71ee81131c2b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070218 Jan 11 14:14:44.018257 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 144/301] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:44.020718 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-73f2c099-692c-4497-b70f-09e49439f328 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.347308 Jan 11 14:14:44.029828 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 158/302] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:43 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:44.240922 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f7f3b699-7ca9-4568-9802-e193cbf02d21 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:44.243103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f7f3b699-7ca9-4568-9802-e193cbf02d21 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:44.260676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f7f3b699-7ca9-4568-9802-e193cbf02d21 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:44.261877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f7f3b699-7ca9-4568-9802-e193cbf02d21 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:44.262939 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f7f3b699-7ca9-4568-9802-e193cbf02d21 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:44.263555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f7f3b699-7ca9-4568-9802-e193cbf02d21 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:44.344372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f7f3b699-7ca9-4568-9802-e193cbf02d21 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.111978 Jan 11 14:14:44.348788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 145/303] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:44 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:44.644194 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-879ba0e7-9c4d-4a2f-ba47-b533a445efb0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:44.644914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-879ba0e7-9c4d-4a2f-ba47-b533a445efb0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:44.653431 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-879ba0e7-9c4d-4a2f-ba47-b533a445efb0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:44.653913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-879ba0e7-9c4d-4a2f-ba47-b533a445efb0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:44.654882 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-879ba0e7-9c4d-4a2f-ba47-b533a445efb0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:44.655575 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-879ba0e7-9c4d-4a2f-ba47-b533a445efb0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:44.677165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cf0999cf-83b3-4b0e-89d8-1457fb8f5c94 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:44.677988 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cf0999cf-83b3-4b0e-89d8-1457fb8f5c94 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:44.694526 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cf0999cf-83b3-4b0e-89d8-1457fb8f5c94 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:44.695300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cf0999cf-83b3-4b0e-89d8-1457fb8f5c94 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:44.705506 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cf0999cf-83b3-4b0e-89d8-1457fb8f5c94 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:44.706595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cf0999cf-83b3-4b0e-89d8-1457fb8f5c94 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.204099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cf0999cf-83b3-4b0e-89d8-1457fb8f5c94 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:45.213324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cf0999cf-83b3-4b0e-89d8-1457fb8f5c94 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1498 microversion: 2.1 time: 0.540528 Jan 11 14:14:45.223636 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-879ba0e7-9c4d-4a2f-ba47-b533a445efb0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:45.226339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 146/304] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:44 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1498 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:45.231580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-879ba0e7-9c4d-4a2f-ba47-b533a445efb0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.591757 Jan 11 14:14:45.240953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 159/305] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:44 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:45.242145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-68f068d5-b9fe-4ad6-8aad-1c9f03c67ef3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:45.242525 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e26cb6ba-96be-4c1c-bdf5-6a4910a175ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:45.242752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-68f068d5-b9fe-4ad6-8aad-1c9f03c67ef3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:45.243916 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e26cb6ba-96be-4c1c-bdf5-6a4910a175ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:45.251927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e26cb6ba-96be-4c1c-bdf5-6a4910a175ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.252632 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e26cb6ba-96be-4c1c-bdf5-6a4910a175ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.253670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e26cb6ba-96be-4c1c-bdf5-6a4910a175ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.254418 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e26cb6ba-96be-4c1c-bdf5-6a4910a175ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.256766 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68f068d5-b9fe-4ad6-8aad-1c9f03c67ef3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.257216 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68f068d5-b9fe-4ad6-8aad-1c9f03c67ef3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.264769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68f068d5-b9fe-4ad6-8aad-1c9f03c67ef3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.265222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68f068d5-b9fe-4ad6-8aad-1c9f03c67ef3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.347459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e26cb6ba-96be-4c1c-bdf5-6a4910a175ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.118881 Jan 11 14:14:45.348654 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 147/306] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:45 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:45.356681 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f78a7c0e-fade-4bee-b5c6-2aa474cbe4d8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:45.357818 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f78a7c0e-fade-4bee-b5c6-2aa474cbe4d8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:45.370085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f78a7c0e-fade-4bee-b5c6-2aa474cbe4d8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.378137 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f78a7c0e-fade-4bee-b5c6-2aa474cbe4d8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.381396 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f78a7c0e-fade-4bee-b5c6-2aa474cbe4d8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.382251 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f78a7c0e-fade-4bee-b5c6-2aa474cbe4d8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.545276 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-68f068d5-b9fe-4ad6-8aad-1c9f03c67ef3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:45.553454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-68f068d5-b9fe-4ad6-8aad-1c9f03c67ef3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.316379 Jan 11 14:14:45.554344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 160/307] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:45 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:45.600478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f78a7c0e-fade-4bee-b5c6-2aa474cbe4d8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.247584 Jan 11 14:14:45.612017 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 148/308] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:45 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:45.791830 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7bb6581a-03fa-4b06-8f5c-92eb3a6674c5 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:45.792340 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7bb6581a-03fa-4b06-8f5c-92eb3a6674c5 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:45.799325 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bb6581a-03fa-4b06-8f5c-92eb3a6674c5 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.799936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bb6581a-03fa-4b06-8f5c-92eb3a6674c5 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.800790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bb6581a-03fa-4b06-8f5c-92eb3a6674c5 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.801295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bb6581a-03fa-4b06-8f5c-92eb3a6674c5 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.826721 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7bb6581a-03fa-4b06-8f5c-92eb3a6674c5 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:14:45.913551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7bb6581a-03fa-4b06-8f5c-92eb3a6674c5 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 204 len: 0 microversion: 2.1 time: 0.125002 Jan 11 14:14:45.914226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 161/309] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:14:45 2022] DELETE /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:14:45.925795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7ca86e92-7ff7-4deb-b328-ccd90fdc63f1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:45.926885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7ca86e92-7ff7-4deb-b328-ccd90fdc63f1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:45.934499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ca86e92-7ff7-4deb-b328-ccd90fdc63f1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.934951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ca86e92-7ff7-4deb-b328-ccd90fdc63f1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:45.935776 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ca86e92-7ff7-4deb-b328-ccd90fdc63f1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:45.936214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7ca86e92-7ff7-4deb-b328-ccd90fdc63f1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.074276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7ca86e92-7ff7-4deb-b328-ccd90fdc63f1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:46.081470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7ca86e92-7ff7-4deb-b328-ccd90fdc63f1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1504 microversion: 2.1 time: 0.161249 Jan 11 14:14:46.082032 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 149/310] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:45 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:46.248876 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c4d9a9ce-6590-426c-b169-da6aebe345e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:46.249575 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c4d9a9ce-6590-426c-b169-da6aebe345e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:46.255296 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c4d9a9ce-6590-426c-b169-da6aebe345e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:46.255841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c4d9a9ce-6590-426c-b169-da6aebe345e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.256626 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c4d9a9ce-6590-426c-b169-da6aebe345e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:46.257058 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c4d9a9ce-6590-426c-b169-da6aebe345e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.359373 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e9fcaee3-0f49-4b25-970e-71e0e2c03490 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:46.360426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e9fcaee3-0f49-4b25-970e-71e0e2c03490 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:46.366579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e9fcaee3-0f49-4b25-970e-71e0e2c03490 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:46.367028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e9fcaee3-0f49-4b25-970e-71e0e2c03490 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.367838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e9fcaee3-0f49-4b25-970e-71e0e2c03490 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:46.368274 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e9fcaee3-0f49-4b25-970e-71e0e2c03490 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.387121 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c4d9a9ce-6590-426c-b169-da6aebe345e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:46.394287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c4d9a9ce-6590-426c-b169-da6aebe345e0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.150021 Jan 11 14:14:46.394858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 162/311] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:46 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:46.571203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e9fcaee3-0f49-4b25-970e-71e0e2c03490 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.215815 Jan 11 14:14:46.571705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a10a1a9c-4b43-4174-9aca-f1e1eb96c1da tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:46.572806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a10a1a9c-4b43-4174-9aca-f1e1eb96c1da tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:46.576361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 150/312] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:46 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:46.580244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a10a1a9c-4b43-4174-9aca-f1e1eb96c1da tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:46.580716 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a10a1a9c-4b43-4174-9aca-f1e1eb96c1da tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.581502 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a10a1a9c-4b43-4174-9aca-f1e1eb96c1da tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:46.581937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a10a1a9c-4b43-4174-9aca-f1e1eb96c1da tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.624364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-79f2a2c6-4a97-41a2-bd0f-50a5781b7342 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:46.625298 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-79f2a2c6-4a97-41a2-bd0f-50a5781b7342 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:46.632106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79f2a2c6-4a97-41a2-bd0f-50a5781b7342 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:46.632553 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79f2a2c6-4a97-41a2-bd0f-50a5781b7342 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.633333 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79f2a2c6-4a97-41a2-bd0f-50a5781b7342 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:46.633765 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79f2a2c6-4a97-41a2-bd0f-50a5781b7342 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:46.714225 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-79f2a2c6-4a97-41a2-bd0f-50a5781b7342 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.093753 Jan 11 14:14:46.718090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 151/313] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:46 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:46.770471 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a10a1a9c-4b43-4174-9aca-f1e1eb96c1da tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:46.777717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a10a1a9c-4b43-4174-9aca-f1e1eb96c1da tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.209804 Jan 11 14:14:46.778269 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 163/314] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:46 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:47.098351 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dccc39d6-be1a-4224-b3e8-f8e79b310586 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:47.099131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dccc39d6-be1a-4224-b3e8-f8e79b310586 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:47.105913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dccc39d6-be1a-4224-b3e8-f8e79b310586 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.106359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dccc39d6-be1a-4224-b3e8-f8e79b310586 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.107146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dccc39d6-be1a-4224-b3e8-f8e79b310586 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.107609 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dccc39d6-be1a-4224-b3e8-f8e79b310586 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.243381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dccc39d6-be1a-4224-b3e8-f8e79b310586 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:47.250931 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dccc39d6-be1a-4224-b3e8-f8e79b310586 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1504 microversion: 2.1 time: 0.156591 Jan 11 14:14:47.251481 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 152/315] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:47 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:47.410761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-575f0974-869e-4fe0-aa79-7767e77faa2b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:47.411376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-575f0974-869e-4fe0-aa79-7767e77faa2b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:47.418177 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-575f0974-869e-4fe0-aa79-7767e77faa2b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.418632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-575f0974-869e-4fe0-aa79-7767e77faa2b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.419417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-575f0974-869e-4fe0-aa79-7767e77faa2b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.419927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-575f0974-869e-4fe0-aa79-7767e77faa2b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.552183 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-575f0974-869e-4fe0-aa79-7767e77faa2b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:47.559945 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-575f0974-869e-4fe0-aa79-7767e77faa2b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.152741 Jan 11 14:14:47.560500 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 164/316] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:47 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:47.583701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-40d5222d-afc7-4ae6-8eac-c83fb9ae9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:47.584548 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-40d5222d-afc7-4ae6-8eac-c83fb9ae9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:47.590733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-40d5222d-afc7-4ae6-8eac-c83fb9ae9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.591303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-40d5222d-afc7-4ae6-8eac-c83fb9ae9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.592514 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-40d5222d-afc7-4ae6-8eac-c83fb9ae9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.592514 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-40d5222d-afc7-4ae6-8eac-c83fb9ae9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.725931 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e3785102-e9d6-467c-9b2c-e4dec1d8a701 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:47.726984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e3785102-e9d6-467c-9b2c-e4dec1d8a701 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:47.729781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-40d5222d-afc7-4ae6-8eac-c83fb9ae9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.149710 Jan 11 14:14:47.731357 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 153/317] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:47 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:47.733697 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e3785102-e9d6-467c-9b2c-e4dec1d8a701 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.734153 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e3785102-e9d6-467c-9b2c-e4dec1d8a701 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.734982 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e3785102-e9d6-467c-9b2c-e4dec1d8a701 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.735414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e3785102-e9d6-467c-9b2c-e4dec1d8a701 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.795217 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4cb13e99-e6e8-412a-9522-c0a35a7b99a1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:47.795998 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4cb13e99-e6e8-412a-9522-c0a35a7b99a1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:47.801971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e3785102-e9d6-467c-9b2c-e4dec1d8a701 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.080372 Jan 11 14:14:47.802806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 165/318] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:47 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:47.802927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4cb13e99-e6e8-412a-9522-c0a35a7b99a1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.803319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4cb13e99-e6e8-412a-9522-c0a35a7b99a1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.804142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4cb13e99-e6e8-412a-9522-c0a35a7b99a1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:47.804582 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4cb13e99-e6e8-412a-9522-c0a35a7b99a1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:47.937413 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4cb13e99-e6e8-412a-9522-c0a35a7b99a1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:47.945322 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4cb13e99-e6e8-412a-9522-c0a35a7b99a1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.154029 Jan 11 14:14:47.945889 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 154/319] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:47 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:48.268381 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-075a8eac-a751-4fd9-b6ec-f7511748eb8b tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:48.269074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-075a8eac-a751-4fd9-b6ec-f7511748eb8b tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:48.275980 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-075a8eac-a751-4fd9-b6ec-f7511748eb8b tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.276430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-075a8eac-a751-4fd9-b6ec-f7511748eb8b tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.277204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-075a8eac-a751-4fd9-b6ec-f7511748eb8b tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.277641 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-075a8eac-a751-4fd9-b6ec-f7511748eb8b tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.441045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-075a8eac-a751-4fd9-b6ec-f7511748eb8b tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:48.448680 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-075a8eac-a751-4fd9-b6ec-f7511748eb8b tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1504 microversion: 2.1 time: 0.183994 Jan 11 14:14:48.449804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 166/320] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:48 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:48.577551 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-42238ab2-b8c7-413d-b29d-450daf26a514 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:48.578264 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-42238ab2-b8c7-413d-b29d-450daf26a514 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:48.584567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-42238ab2-b8c7-413d-b29d-450daf26a514 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.585179 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-42238ab2-b8c7-413d-b29d-450daf26a514 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.585904 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-42238ab2-b8c7-413d-b29d-450daf26a514 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.586585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-42238ab2-b8c7-413d-b29d-450daf26a514 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.742630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-75359e01-99df-4556-8dfe-283612864d24 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:48.743981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-75359e01-99df-4556-8dfe-283612864d24 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:48.750959 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-75359e01-99df-4556-8dfe-283612864d24 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.751411 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-75359e01-99df-4556-8dfe-283612864d24 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.752274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-75359e01-99df-4556-8dfe-283612864d24 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.752714 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-75359e01-99df-4556-8dfe-283612864d24 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.821800 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-75359e01-99df-4556-8dfe-283612864d24 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.082597 Jan 11 14:14:48.822481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 167/321] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:48 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:48.831241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-edda7438-33c0-428c-bf52-91e37b5ca479 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:48.832281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-edda7438-33c0-428c-bf52-91e37b5ca479 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:48.840735 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-42238ab2-b8c7-413d-b29d-450daf26a514 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:48.852236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-edda7438-33c0-428c-bf52-91e37b5ca479 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.852810 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-edda7438-33c0-428c-bf52-91e37b5ca479 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.853085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-42238ab2-b8c7-413d-b29d-450daf26a514 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1521 microversion: 2.1 time: 0.279830 Jan 11 14:14:48.853602 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-edda7438-33c0-428c-bf52-91e37b5ca479 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.854032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-edda7438-33c0-428c-bf52-91e37b5ca479 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.864950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 155/322] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:48 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:48.929663 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-edda7438-33c0-428c-bf52-91e37b5ca479 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.105290 Jan 11 14:14:48.933545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 168/323] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:48 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:48.962389 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1343c11a-8f09-4fe4-aad7-311d22ab1f40 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:48.962981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1343c11a-8f09-4fe4-aad7-311d22ab1f40 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:48.969469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1343c11a-8f09-4fe4-aad7-311d22ab1f40 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.970023 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1343c11a-8f09-4fe4-aad7-311d22ab1f40 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:48.970801 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1343c11a-8f09-4fe4-aad7-311d22ab1f40 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:48.971233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1343c11a-8f09-4fe4-aad7-311d22ab1f40 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.207590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-2c86417a-02b0-431a-9892-bb6bcbfe8db3 req-2ff62b2b-002e-4289-bf11-1e88e47ff51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d97571e-9535-4d22-a9be-ee6cd65c65ed", "name": "network-vif-deleted", "tag": "37a394de-2958-4344-b1a2-0e94b960aece"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:49.209194 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:49.209194 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:14:49.228144 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-2c86417a-02b0-431a-9892-bb6bcbfe8db3 req-2ff62b2b-002e-4289-bf11-1e88e47ff51f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.228855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-2c86417a-02b0-431a-9892-bb6bcbfe8db3 req-2ff62b2b-002e-4289-bf11-1e88e47ff51f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.246915 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1343c11a-8f09-4fe4-aad7-311d22ab1f40 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:49.254267 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1343c11a-8f09-4fe4-aad7-311d22ab1f40 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.295957 Jan 11 14:14:49.255220 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-2c86417a-02b0-431a-9892-bb6bcbfe8db3 req-2ff62b2b-002e-4289-bf11-1e88e47ff51f service nova] Creating event network-vif-deleted:37a394de-2958-4344-b1a2-0e94b960aece for instance 0d97571e-9535-4d22-a9be-ee6cd65c65ed on hv-cinder-82413 Jan 11 14:14:49.266606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 156/324] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:48 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:49.271629 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-2c86417a-02b0-431a-9892-bb6bcbfe8db3 req-2ff62b2b-002e-4289-bf11-1e88e47ff51f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069527 Jan 11 14:14:49.272447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 169/325] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:49.466800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:49.467352 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:49.479096 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.479573 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.480861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.481295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.510582 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.511048 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.511478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lazy-loading 'fault' on Instance uuid 0d97571e-9535-4d22-a9be-ee6cd65c65ed {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:14:49.552389 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:49.560025 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c0407b1b-68da-4ffa-92ae-9752c0ca7f50 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 200 len: 1304 microversion: 2.1 time: 0.097590 Jan 11 14:14:49.560579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 157/326] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:49 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:49.836623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f565e016-4c32-42f1-9c54-49882bced657 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:49.837622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f565e016-4c32-42f1-9c54-49882bced657 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:49.844673 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f565e016-4c32-42f1-9c54-49882bced657 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.845112 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f565e016-4c32-42f1-9c54-49882bced657 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.846095 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f565e016-4c32-42f1-9c54-49882bced657 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.846541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f565e016-4c32-42f1-9c54-49882bced657 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.870230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-228f2692-9e27-4515-814d-30a749da0b36 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:49.870873 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-228f2692-9e27-4515-814d-30a749da0b36 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:49.889320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-228f2692-9e27-4515-814d-30a749da0b36 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.889807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-228f2692-9e27-4515-814d-30a749da0b36 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.890633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-228f2692-9e27-4515-814d-30a749da0b36 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.891069 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-228f2692-9e27-4515-814d-30a749da0b36 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.938253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f565e016-4c32-42f1-9c54-49882bced657 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.106533 Jan 11 14:14:49.939127 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 170/327] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:49 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:49.944174 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3d8e0f35-e38a-41ff-8e05-a879c11abc9d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:49.946931 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3d8e0f35-e38a-41ff-8e05-a879c11abc9d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:49.952278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3d8e0f35-e38a-41ff-8e05-a879c11abc9d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.952733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3d8e0f35-e38a-41ff-8e05-a879c11abc9d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:49.953520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3d8e0f35-e38a-41ff-8e05-a879c11abc9d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:49.953954 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3d8e0f35-e38a-41ff-8e05-a879c11abc9d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:50.025541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3d8e0f35-e38a-41ff-8e05-a879c11abc9d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.085003 Jan 11 14:14:50.026312 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 171/328] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:49 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:50.043207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-228f2692-9e27-4515-814d-30a749da0b36 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:50.050783 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-228f2692-9e27-4515-814d-30a749da0b36 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1501 microversion: 2.1 time: 0.184172 Jan 11 14:14:50.051349 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 158/329] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:49 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:50.067425 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8e7d90cb-ae0d-460e-8777-e9f14845e051 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:50.068312 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8e7d90cb-ae0d-460e-8777-e9f14845e051 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:50.076093 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8e7d90cb-ae0d-460e-8777-e9f14845e051 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:50.076624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8e7d90cb-ae0d-460e-8777-e9f14845e051 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:50.077429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8e7d90cb-ae0d-460e-8777-e9f14845e051 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:50.077869 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8e7d90cb-ae0d-460e-8777-e9f14845e051 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:50.220569 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8e7d90cb-ae0d-460e-8777-e9f14845e051 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:50.227825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8e7d90cb-ae0d-460e-8777-e9f14845e051 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1515 microversion: 2.1 time: 0.164342 Jan 11 14:14:50.228392 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 172/330] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:50 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:50.273225 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-09ae63b5-7391-4cfc-a2f4-5f8dc3147234 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:50.273864 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-09ae63b5-7391-4cfc-a2f4-5f8dc3147234 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:50.280732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-09ae63b5-7391-4cfc-a2f4-5f8dc3147234 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:50.281210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-09ae63b5-7391-4cfc-a2f4-5f8dc3147234 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:50.282000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-09ae63b5-7391-4cfc-a2f4-5f8dc3147234 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:50.282746 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-09ae63b5-7391-4cfc-a2f4-5f8dc3147234 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:50.455042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-09ae63b5-7391-4cfc-a2f4-5f8dc3147234 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:50.462739 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-09ae63b5-7391-4cfc-a2f4-5f8dc3147234 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.193983 Jan 11 14:14:50.463382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 159/331] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:50 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:50.577818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:50.578429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: 0d97571e-9535-4d22-a9be-ee6cd65c65ed] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:50.584487 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:50.584937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:50.585717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:50.586151 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:50.600721 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] HTTP exception thrown: Instance 0d97571e-9535-4d22-a9be-ee6cd65c65ed could not be found. Jan 11 14:14:50.601320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Returning 404 to user: Instance 0d97571e-9535-4d22-a9be-ee6cd65c65ed could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:14:50.602415 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d60999f4-bf6c-4ea1-bca2-35cf863e662f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed" status: 404 len: 111 microversion: 2.1 time: 0.028993 Jan 11 14:14:50.602982 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 173/332] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:50 2022] GET /compute/v2.1/servers/0d97571e-9535-4d22-a9be-ee6cd65c65ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:14:50.697654 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1979275595", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "7b5e68a5-0493-4fc3-a425-de993e119741"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:50.950295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4cbe7838-e770-4edf-b8ea-17f8232d5eff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:50.951208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4cbe7838-e770-4edf-b8ea-17f8232d5eff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:50.957465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4cbe7838-e770-4edf-b8ea-17f8232d5eff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:50.957912 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4cbe7838-e770-4edf-b8ea-17f8232d5eff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:50.958709 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4cbe7838-e770-4edf-b8ea-17f8232d5eff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:50.959142 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4cbe7838-e770-4edf-b8ea-17f8232d5eff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:51.119318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4cbe7838-e770-4edf-b8ea-17f8232d5eff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.173234 Jan 11 14:14:51.119927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 174/333] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:50 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:51.125574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e599185a-8044-4079-b896-db2849f560d6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:51.126548 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e599185a-8044-4079-b896-db2849f560d6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:51.133313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e599185a-8044-4079-b896-db2849f560d6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:51.133761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e599185a-8044-4079-b896-db2849f560d6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:51.134531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e599185a-8044-4079-b896-db2849f560d6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:51.135051 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e599185a-8044-4079-b896-db2849f560d6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:51.202841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e599185a-8044-4079-b896-db2849f560d6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.080798 Jan 11 14:14:51.203486 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 175/334] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:51 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:51.482496 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4457f8bf-b5d9-43f0-bf2e-ff1d7f67f519 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:51.483192 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4457f8bf-b5d9-43f0-bf2e-ff1d7f67f519 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:51.490052 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4457f8bf-b5d9-43f0-bf2e-ff1d7f67f519 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:51.490504 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4457f8bf-b5d9-43f0-bf2e-ff1d7f67f519 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:51.491278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4457f8bf-b5d9-43f0-bf2e-ff1d7f67f519 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:51.491739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4457f8bf-b5d9-43f0-bf2e-ff1d7f67f519 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:51.633055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4457f8bf-b5d9-43f0-bf2e-ff1d7f67f519 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:51.640525 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4457f8bf-b5d9-43f0-bf2e-ff1d7f67f519 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.162574 Jan 11 14:14:51.641087 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 176/335] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:51 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:51.645503 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ec9da2ee-132e-44be-b28c-d736f606494d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:51.646407 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ec9da2ee-132e-44be-b28c-d736f606494d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:51.651744 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec9da2ee-132e-44be-b28c-d736f606494d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:51.652187 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec9da2ee-132e-44be-b28c-d736f606494d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:51.652959 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec9da2ee-132e-44be-b28c-d736f606494d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:51.653387 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec9da2ee-132e-44be-b28c-d736f606494d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:51.676024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-ec9da2ee-132e-44be-b28c-d736f606494d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lazy-loading 'flavor' on Instance uuid efdb5bf8-cc2d-4e01-ad4d-6a9647801384 {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:14:51.746235 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ec9da2ee-132e-44be-b28c-d736f606494d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/action" status: 200 len: 32 microversion: 2.1 time: 0.103423 Jan 11 14:14:51.746953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 177/336] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:51 2022] POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/action => generated 32 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:14:51.757981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7800dc22-1f56-454a-9c19-af72e849a566 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:51.758674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7800dc22-1f56-454a-9c19-af72e849a566 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:51.765653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7800dc22-1f56-454a-9c19-af72e849a566 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:51.766212 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7800dc22-1f56-454a-9c19-af72e849a566 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:51.767175 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7800dc22-1f56-454a-9c19-af72e849a566 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:51.767712 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7800dc22-1f56-454a-9c19-af72e849a566 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:52.185901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7800dc22-1f56-454a-9c19-af72e849a566 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:52.196085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7800dc22-1f56-454a-9c19-af72e849a566 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.443611 Jan 11 14:14:52.196660 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 178/337] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:51 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:52.209227 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6de6099e-f84c-4e53-83c6-6af02c7a2ab4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:52.209895 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6de6099e-f84c-4e53-83c6-6af02c7a2ab4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:52.217638 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6de6099e-f84c-4e53-83c6-6af02c7a2ab4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:52.218258 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6de6099e-f84c-4e53-83c6-6af02c7a2ab4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:52.219048 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6de6099e-f84c-4e53-83c6-6af02c7a2ab4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:52.219477 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6de6099e-f84c-4e53-83c6-6af02c7a2ab4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:52.290611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6de6099e-f84c-4e53-83c6-6af02c7a2ab4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.085727 Jan 11 14:14:52.291264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 179/338] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:52 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:52.297032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3579a44e-1e0b-48c3-9c64-0e318cb51564 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:52.298017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3579a44e-1e0b-48c3-9c64-0e318cb51564 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:52.304867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3579a44e-1e0b-48c3-9c64-0e318cb51564 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:52.305465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3579a44e-1e0b-48c3-9c64-0e318cb51564 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:52.306257 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3579a44e-1e0b-48c3-9c64-0e318cb51564 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:52.306695 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3579a44e-1e0b-48c3-9c64-0e318cb51564 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:52.394769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3579a44e-1e0b-48c3-9c64-0e318cb51564 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.101935 Jan 11 14:14:52.395611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 180/339] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:52 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:52.658629 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e4d6912c-9e60-47cb-bb37-32324c5afdd9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:52.659380 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e4d6912c-9e60-47cb-bb37-32324c5afdd9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:52.666430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e4d6912c-9e60-47cb-bb37-32324c5afdd9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:52.666880 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e4d6912c-9e60-47cb-bb37-32324c5afdd9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:52.667721 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e4d6912c-9e60-47cb-bb37-32324c5afdd9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:52.668158 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e4d6912c-9e60-47cb-bb37-32324c5afdd9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:52.805868 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e4d6912c-9e60-47cb-bb37-32324c5afdd9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:52.815261 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e4d6912c-9e60-47cb-bb37-32324c5afdd9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.160520 Jan 11 14:14:52.815879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 181/340] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:52 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:53.211975 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-b3c10db2-f789-4907-92ee-3ff794961111 req-edcf2d07-fadc-4af0-a879-1297246f278e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe790a9d-f25c-4f0c-852d-3155d29520c0", "name": "network-vif-plugged", "status": "completed", "tag": "e6f3dc3e-4f1c-4201-b63f-f6a4b7ffd872"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:53.216318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:14:53.216318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:14:53.225620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b3c10db2-f789-4907-92ee-3ff794961111 req-edcf2d07-fadc-4af0-a879-1297246f278e service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.226076 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b3c10db2-f789-4907-92ee-3ff794961111 req-edcf2d07-fadc-4af0-a879-1297246f278e service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:53.239570 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-b3c10db2-f789-4907-92ee-3ff794961111 req-edcf2d07-fadc-4af0-a879-1297246f278e service nova] Creating event network-vif-plugged:e6f3dc3e-4f1c-4201-b63f-f6a4b7ffd872 for instance fe790a9d-f25c-4f0c-852d-3155d29520c0 on hv-cinder-82413 Jan 11 14:14:53.244977 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-b3c10db2-f789-4907-92ee-3ff794961111 req-edcf2d07-fadc-4af0-a879-1297246f278e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036791 Jan 11 14:14:53.245611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 182/341] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:53.250763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bf09200f-b93c-450a-83f3-d450a23d1ee7 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:53.251038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bf09200f-b93c-450a-83f3-d450a23d1ee7 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:53.258652 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bf09200f-b93c-450a-83f3-d450a23d1ee7 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.259100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bf09200f-b93c-450a-83f3-d450a23d1ee7 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:53.259934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bf09200f-b93c-450a-83f3-d450a23d1ee7 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.260367 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bf09200f-b93c-450a-83f3-d450a23d1ee7 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:53.398732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-bf09200f-b93c-450a-83f3-d450a23d1ee7 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:53.406924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bf09200f-b93c-450a-83f3-d450a23d1ee7 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.160203 Jan 11 14:14:53.407521 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 183/342] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:53 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:53.412151 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e5139017-f9b6-4ae0-90d1-7aacb7c1fd6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:53.413053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e5139017-f9b6-4ae0-90d1-7aacb7c1fd6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:53.418962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e5139017-f9b6-4ae0-90d1-7aacb7c1fd6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.419698 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e5139017-f9b6-4ae0-90d1-7aacb7c1fd6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:53.420545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e5139017-f9b6-4ae0-90d1-7aacb7c1fd6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.420987 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e5139017-f9b6-4ae0-90d1-7aacb7c1fd6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:53.495287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e5139017-f9b6-4ae0-90d1-7aacb7c1fd6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.086406 Jan 11 14:14:53.496580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 184/343] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:53 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:53.501992 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6b576c1f-b059-4846-bf94-8169ae3e70be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:53.503252 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6b576c1f-b059-4846-bf94-8169ae3e70be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:53.510948 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b576c1f-b059-4846-bf94-8169ae3e70be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.511666 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b576c1f-b059-4846-bf94-8169ae3e70be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:53.512463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b576c1f-b059-4846-bf94-8169ae3e70be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.512898 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b576c1f-b059-4846-bf94-8169ae3e70be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:53.833737 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6b576c1f-b059-4846-bf94-8169ae3e70be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.335841 Jan 11 14:14:53.834448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 185/344] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:53 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:53.839877 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-493aaf5a-c50d-4e5e-8875-506e5582aa59 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:53.841035 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-493aaf5a-c50d-4e5e-8875-506e5582aa59 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:53.848250 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-493aaf5a-c50d-4e5e-8875-506e5582aa59 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.848719 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-493aaf5a-c50d-4e5e-8875-506e5582aa59 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:53.849620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-493aaf5a-c50d-4e5e-8875-506e5582aa59 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:53.850032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-493aaf5a-c50d-4e5e-8875-506e5582aa59 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:54.006198 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-493aaf5a-c50d-4e5e-8875-506e5582aa59 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:54.015644 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-493aaf5a-c50d-4e5e-8875-506e5582aa59 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.179741 Jan 11 14:14:54.016204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 186/345] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:53 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:54.423457 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-298c171d-c63b-4c69-882b-35de18d28906 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:54.424247 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-298c171d-c63b-4c69-882b-35de18d28906 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:54.430294 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-298c171d-c63b-4c69-882b-35de18d28906 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:54.430739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-298c171d-c63b-4c69-882b-35de18d28906 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:54.431537 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-298c171d-c63b-4c69-882b-35de18d28906 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:54.431972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-298c171d-c63b-4c69-882b-35de18d28906 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:54.566161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-298c171d-c63b-4c69-882b-35de18d28906 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:54.574216 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-298c171d-c63b-4c69-882b-35de18d28906 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.153662 Jan 11 14:14:54.574790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 187/346] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:54 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:54.579121 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4949ab8a-22de-481a-a670-9fd2d80f5f19 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:54.580047 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4949ab8a-22de-481a-a670-9fd2d80f5f19 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:54.585405 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4949ab8a-22de-481a-a670-9fd2d80f5f19 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:54.585854 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4949ab8a-22de-481a-a670-9fd2d80f5f19 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:54.586632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4949ab8a-22de-481a-a670-9fd2d80f5f19 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:54.587070 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4949ab8a-22de-481a-a670-9fd2d80f5f19 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:54.691075 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4949ab8a-22de-481a-a670-9fd2d80f5f19 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.114975 Jan 11 14:14:54.691930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 188/347] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:54 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:54.846337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b7241bf1-21a1-4261-95e3-b83db03d2cfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:54.847326 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b7241bf1-21a1-4261-95e3-b83db03d2cfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:54.854509 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7241bf1-21a1-4261-95e3-b83db03d2cfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:54.855619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7241bf1-21a1-4261-95e3-b83db03d2cfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:54.856435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7241bf1-21a1-4261-95e3-b83db03d2cfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:54.856869 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7241bf1-21a1-4261-95e3-b83db03d2cfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:54.948949 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b7241bf1-21a1-4261-95e3-b83db03d2cfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.106101 Jan 11 14:14:54.949774 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 189/348] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:54 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:55.032984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f54c6246-ded9-4524-85cf-307622404e39 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:55.033678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f54c6246-ded9-4524-85cf-307622404e39 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:55.040435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f54c6246-ded9-4524-85cf-307622404e39 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:55.040887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f54c6246-ded9-4524-85cf-307622404e39 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:55.041668 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f54c6246-ded9-4524-85cf-307622404e39 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:55.042102 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f54c6246-ded9-4524-85cf-307622404e39 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:55.193391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f54c6246-ded9-4524-85cf-307622404e39 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:55.201954 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f54c6246-ded9-4524-85cf-307622404e39 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1317 microversion: 2.1 time: 0.172741 Jan 11 14:14:55.216836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 190/349] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:55 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:55.591287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-caefe537-20c2-4bea-9e55-94ac46963dc9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:55.591957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-caefe537-20c2-4bea-9e55-94ac46963dc9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:55.598202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-caefe537-20c2-4bea-9e55-94ac46963dc9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:55.598656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-caefe537-20c2-4bea-9e55-94ac46963dc9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:55.599476 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-caefe537-20c2-4bea-9e55-94ac46963dc9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:55.599956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-caefe537-20c2-4bea-9e55-94ac46963dc9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:55.735436 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-caefe537-20c2-4bea-9e55-94ac46963dc9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:55.745742 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-caefe537-20c2-4bea-9e55-94ac46963dc9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.158682 Jan 11 14:14:55.746320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 191/350] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:55 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:55.750832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-619ddfad-be02-44b3-bbbf-da694d0f1f10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:55.751741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-619ddfad-be02-44b3-bbbf-da694d0f1f10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:55.757446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-619ddfad-be02-44b3-bbbf-da694d0f1f10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:55.757884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-619ddfad-be02-44b3-bbbf-da694d0f1f10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:55.758647 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-619ddfad-be02-44b3-bbbf-da694d0f1f10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:55.759073 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-619ddfad-be02-44b3-bbbf-da694d0f1f10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:55.859711 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-619ddfad-be02-44b3-bbbf-da694d0f1f10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.112007 Jan 11 14:14:55.861188 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 192/351] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:55 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:55.960711 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0daa0d6a-07fe-425d-9a6a-661d4924c5f6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:55.961697 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0daa0d6a-07fe-425d-9a6a-661d4924c5f6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:55.969103 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0daa0d6a-07fe-425d-9a6a-661d4924c5f6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:55.970168 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0daa0d6a-07fe-425d-9a6a-661d4924c5f6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:55.970941 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0daa0d6a-07fe-425d-9a6a-661d4924c5f6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:55.971374 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0daa0d6a-07fe-425d-9a6a-661d4924c5f6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:56.061115 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0daa0d6a-07fe-425d-9a6a-661d4924c5f6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.104193 Jan 11 14:14:56.061791 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 193/352] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:55 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:56.219222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9d663f9f-d97a-419d-95fc-6442e1f432ff tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:56.219958 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9d663f9f-d97a-419d-95fc-6442e1f432ff tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:56.227150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9d663f9f-d97a-419d-95fc-6442e1f432ff tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:56.227271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9d663f9f-d97a-419d-95fc-6442e1f432ff tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:56.228071 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9d663f9f-d97a-419d-95fc-6442e1f432ff tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:56.228505 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9d663f9f-d97a-419d-95fc-6442e1f432ff tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:56.366841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9d663f9f-d97a-419d-95fc-6442e1f432ff tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:56.375201 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9d663f9f-d97a-419d-95fc-6442e1f432ff tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1507 microversion: 2.1 time: 0.159904 Jan 11 14:14:56.376094 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 194/353] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:56 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:56.762574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-70ca45c4-8df0-40f5-91ab-853266d32cd5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:56.763190 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-70ca45c4-8df0-40f5-91ab-853266d32cd5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:56.769403 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70ca45c4-8df0-40f5-91ab-853266d32cd5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:56.769851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70ca45c4-8df0-40f5-91ab-853266d32cd5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:56.770636 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70ca45c4-8df0-40f5-91ab-853266d32cd5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:56.771074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70ca45c4-8df0-40f5-91ab-853266d32cd5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:56.907608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-70ca45c4-8df0-40f5-91ab-853266d32cd5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:56.916999 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-70ca45c4-8df0-40f5-91ab-853266d32cd5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.158335 Jan 11 14:14:56.918469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 195/354] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:56 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:14:56.923069 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-52a5d6d4-4267-4738-b62d-92b837ba8084 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:56.923994 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-52a5d6d4-4267-4738-b62d-92b837ba8084 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:56.929587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-52a5d6d4-4267-4738-b62d-92b837ba8084 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:56.930033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-52a5d6d4-4267-4738-b62d-92b837ba8084 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:56.930806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-52a5d6d4-4267-4738-b62d-92b837ba8084 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:56.931237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-52a5d6d4-4267-4738-b62d-92b837ba8084 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:56.997582 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-52a5d6d4-4267-4738-b62d-92b837ba8084 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.077615 Jan 11 14:14:56.998831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 196/355] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:56 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:57.012516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] validate_networks() for [('7b5e68a5-0493-4fc3-a425-de993e119741', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:14:57.073361 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-42b44e24-a714-4daa-810e-d137d0cc47c9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:57.074947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-42b44e24-a714-4daa-810e-d137d0cc47c9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:57.081979 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-42b44e24-a714-4daa-810e-d137d0cc47c9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:57.082429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-42b44e24-a714-4daa-810e-d137d0cc47c9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:57.083220 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-42b44e24-a714-4daa-810e-d137d0cc47c9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:57.083681 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-42b44e24-a714-4daa-810e-d137d0cc47c9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:57.165118 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-42b44e24-a714-4daa-810e-d137d0cc47c9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28156 microversion: 2.1 time: 0.095853 Jan 11 14:14:57.165766 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 197/356] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:57 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28156 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:57.379059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:14:57.379485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:14:57.380010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:14:57.380421 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:14:57.380829 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:14:57.389815 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:57.390261 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:57.391068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:57.391572 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:57.407087 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Getting quotas for project 61ee5ce1ef8d4f0ba4a225c91b7f6d05. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:14:57.411141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Getting quotas for user 5951e83a1eae43f4a8f9b3ebebc23350 and project 61ee5ce1ef8d4f0ba4a225c91b7f6d05. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:14:57.421449 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:14:57.423723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:14:57.468937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-24e74c3c-4e7a-4db8-8441-b73db8209c28 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.774934 Jan 11 14:14:57.469574 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 160/357] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:14:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 6776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:14:57.479909 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4dea1b13-abf0-423c-ba8d-f6f6e1393009 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:57.480692 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4dea1b13-abf0-423c-ba8d-f6f6e1393009 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:57.533491 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4dea1b13-abf0-423c-ba8d-f6f6e1393009 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:57.541167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4dea1b13-abf0-423c-ba8d-f6f6e1393009 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1214 microversion: 2.1 time: 0.065444 Jan 11 14:14:57.541950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 198/358] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:57 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:57.935708 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-60c18956-cc12-4d49-a3b0-0a0ab2b92502 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:57.936234 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-60c18956-cc12-4d49-a3b0-0a0ab2b92502 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:57.943279 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-60c18956-cc12-4d49-a3b0-0a0ab2b92502 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:57.943881 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-60c18956-cc12-4d49-a3b0-0a0ab2b92502 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:57.944685 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-60c18956-cc12-4d49-a3b0-0a0ab2b92502 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:57.945107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-60c18956-cc12-4d49-a3b0-0a0ab2b92502 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:58.009245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-be913cf9-2781-491e-8230-ab79dbd00865 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:58.010210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-be913cf9-2781-491e-8230-ab79dbd00865 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:58.017126 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be913cf9-2781-491e-8230-ab79dbd00865 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:58.017568 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be913cf9-2781-491e-8230-ab79dbd00865 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:58.018376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be913cf9-2781-491e-8230-ab79dbd00865 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:58.019008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-be913cf9-2781-491e-8230-ab79dbd00865 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:58.084003 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-60c18956-cc12-4d49-a3b0-0a0ab2b92502 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:58.092104 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-60c18956-cc12-4d49-a3b0-0a0ab2b92502 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.161331 Jan 11 14:14:58.092437 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-be913cf9-2781-491e-8230-ab79dbd00865 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28255 microversion: 2.20 time: 0.086845 Jan 11 14:14:58.092667 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 161/359] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:57 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:58.096224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 199/360] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:58 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28255 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:14:58.177039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-03a3111b-ba2b-470f-8961-abea81982962 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:58.178046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-03a3111b-ba2b-470f-8961-abea81982962 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:58.184099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03a3111b-ba2b-470f-8961-abea81982962 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:58.184552 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03a3111b-ba2b-470f-8961-abea81982962 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:58.185384 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03a3111b-ba2b-470f-8961-abea81982962 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:58.185878 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03a3111b-ba2b-470f-8961-abea81982962 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:58.286836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-03a3111b-ba2b-470f-8961-abea81982962 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28171 microversion: 2.1 time: 0.112945 Jan 11 14:14:58.288414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 162/361] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:58 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28171 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:14:58.558545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8f6e8cd6-356f-402b-96b1-2301c9f8e51d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:58.559258 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8f6e8cd6-356f-402b-96b1-2301c9f8e51d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:58.566457 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8f6e8cd6-356f-402b-96b1-2301c9f8e51d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:58.566906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8f6e8cd6-356f-402b-96b1-2301c9f8e51d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:58.568066 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8f6e8cd6-356f-402b-96b1-2301c9f8e51d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:58.568770 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8f6e8cd6-356f-402b-96b1-2301c9f8e51d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:58.657096 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8f6e8cd6-356f-402b-96b1-2301c9f8e51d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:58.669088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8f6e8cd6-356f-402b-96b1-2301c9f8e51d tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1284 microversion: 2.1 time: 0.114583 Jan 11 14:14:58.671532 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 200/362] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:58 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:58.807356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6eed7cf0-d767-431f-873c-89b6f5b5c954 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21c22162-d955-445b-80e5-83d3c59edf77"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:58.809320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6eed7cf0-d767-431f-873c-89b6f5b5c954 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:58.816762 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6eed7cf0-d767-431f-873c-89b6f5b5c954 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:58.817502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6eed7cf0-d767-431f-873c-89b6f5b5c954 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:58.818293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6eed7cf0-d767-431f-873c-89b6f5b5c954 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:58.818878 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6eed7cf0-d767-431f-873c-89b6f5b5c954 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.105379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8f9a7fd6-55a4-4ee9-a2ed-89bd6cc03860 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:59.106608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8f9a7fd6-55a4-4ee9-a2ed-89bd6cc03860 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:59.114355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8f9a7fd6-55a4-4ee9-a2ed-89bd6cc03860 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:59.115108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8f9a7fd6-55a4-4ee9-a2ed-89bd6cc03860 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.116703 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8f9a7fd6-55a4-4ee9-a2ed-89bd6cc03860 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:59.117733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6eed7cf0-d767-431f-873c-89b6f5b5c954 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314299 Jan 11 14:14:59.118276 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8f9a7fd6-55a4-4ee9-a2ed-89bd6cc03860 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.123637 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 163/363] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:14:58 2022] POST /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:14:59.135577 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4b1aeaaf-dbc1-4f35-9795-10c26e393982 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:59.144276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4b1aeaaf-dbc1-4f35-9795-10c26e393982 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:59.155648 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4b1aeaaf-dbc1-4f35-9795-10c26e393982 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:59.156826 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4b1aeaaf-dbc1-4f35-9795-10c26e393982 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.158142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4b1aeaaf-dbc1-4f35-9795-10c26e393982 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:59.158885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4b1aeaaf-dbc1-4f35-9795-10c26e393982 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.259973 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8f9a7fd6-55a4-4ee9-a2ed-89bd6cc03860 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28545 microversion: 2.20 time: 0.159035 Jan 11 14:14:59.261606 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 201/364] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:14:59 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28545 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:14:59.301796 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b0a45897-9a37-4db1-97b3-0ecbb6e75b38 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:14:59.302557 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b0a45897-9a37-4db1-97b3-0ecbb6e75b38 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:59.311727 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b0a45897-9a37-4db1-97b3-0ecbb6e75b38 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:59.312167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b0a45897-9a37-4db1-97b3-0ecbb6e75b38 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.312913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b0a45897-9a37-4db1-97b3-0ecbb6e75b38 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:59.313350 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b0a45897-9a37-4db1-97b3-0ecbb6e75b38 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.394682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4b1aeaaf-dbc1-4f35-9795-10c26e393982 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:59.403244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b0a45897-9a37-4db1-97b3-0ecbb6e75b38 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28446 microversion: 2.1 time: 0.107177 Jan 11 14:14:59.403444 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4b1aeaaf-dbc1-4f35-9795-10c26e393982 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.272988 Jan 11 14:14:59.407080 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 202/365] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:14:59 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28446 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:14:59.407812 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 164/366] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:59 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:14:59.688963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cd45a324-6374-4bb9-afa6-f3393ac06d46 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:14:59.689889 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cd45a324-6374-4bb9-afa6-f3393ac06d46 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:14:59.698442 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cd45a324-6374-4bb9-afa6-f3393ac06d46 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:59.699613 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cd45a324-6374-4bb9-afa6-f3393ac06d46 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.700884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cd45a324-6374-4bb9-afa6-f3393ac06d46 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:14:59.701315 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cd45a324-6374-4bb9-afa6-f3393ac06d46 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:14:59.930238 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cd45a324-6374-4bb9-afa6-f3393ac06d46 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:14:59.938710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cd45a324-6374-4bb9-afa6-f3393ac06d46 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.254061 Jan 11 14:14:59.939615 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 203/367] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:14:59 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:00.012191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-e3fbc682-b189-4036-b143-83161880206d req-68663b8c-afc6-4687-9538-b950d78eb4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b9c6f8-3513-4858-b580-8f5a465cdcb0", "tag": "a8aea5d9-aedf-4c6e-954b-f6474f93a6d2"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:00.014196 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:15:00.014196 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:15:00.023450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-e3fbc682-b189-4036-b143-83161880206d req-68663b8c-afc6-4687-9538-b950d78eb4a2 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.024499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-e3fbc682-b189-4036-b143-83161880206d req-68663b8c-afc6-4687-9538-b950d78eb4a2 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:00.037675 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-e3fbc682-b189-4036-b143-83161880206d req-68663b8c-afc6-4687-9538-b950d78eb4a2 service nova] Creating event network-changed:a8aea5d9-aedf-4c6e-954b-f6474f93a6d2 for instance a6b9c6f8-3513-4858-b580-8f5a465cdcb0 on hv-cinder-82413 Jan 11 14:15:00.043318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-e3fbc682-b189-4036-b143-83161880206d req-68663b8c-afc6-4687-9538-b950d78eb4a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034221 Jan 11 14:15:00.043935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 165/368] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:15:00.271929 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b522576e-6f4b-4b6d-af35-028e5ab8c5d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:00.272934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b522576e-6f4b-4b6d-af35-028e5ab8c5d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:00.279164 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b522576e-6f4b-4b6d-af35-028e5ab8c5d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.279741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b522576e-6f4b-4b6d-af35-028e5ab8c5d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:00.280585 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b522576e-6f4b-4b6d-af35-028e5ab8c5d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.281083 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b522576e-6f4b-4b6d-af35-028e5ab8c5d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:00.364758 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b522576e-6f4b-4b6d-af35-028e5ab8c5d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28545 microversion: 2.20 time: 0.096291 Jan 11 14:15:00.365428 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 204/369] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:00 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28545 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:00.415412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c34ee712-6b4d-4082-b422-c574ea3a27c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:00.416489 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c34ee712-6b4d-4082-b422-c574ea3a27c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:00.424360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cc3bf132-c695-4ad7-b829-c133ec18bd78 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:00.424605 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c34ee712-6b4d-4082-b422-c574ea3a27c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.425063 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cc3bf132-c695-4ad7-b829-c133ec18bd78 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:00.425238 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c34ee712-6b4d-4082-b422-c574ea3a27c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:00.426043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c34ee712-6b4d-4082-b422-c574ea3a27c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.426633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c34ee712-6b4d-4082-b422-c574ea3a27c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:00.431692 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cc3bf132-c695-4ad7-b829-c133ec18bd78 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.432140 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cc3bf132-c695-4ad7-b829-c133ec18bd78 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:00.434992 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cc3bf132-c695-4ad7-b829-c133ec18bd78 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.435666 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cc3bf132-c695-4ad7-b829-c133ec18bd78 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:00.537867 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c34ee712-6b4d-4082-b422-c574ea3a27c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28446 microversion: 2.1 time: 0.126724 Jan 11 14:15:00.542025 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 166/370] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:00 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:00.658191 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cc3bf132-c695-4ad7-b829-c133ec18bd78 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:00.665440 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cc3bf132-c695-4ad7-b829-c133ec18bd78 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.245687 Jan 11 14:15:00.666005 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 205/371] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:00 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:00.956496 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cae1519b-ad58-4bb6-9fee-bdab00bc57a3 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:00.957574 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cae1519b-ad58-4bb6-9fee-bdab00bc57a3 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:00.964245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cae1519b-ad58-4bb6-9fee-bdab00bc57a3 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.964950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cae1519b-ad58-4bb6-9fee-bdab00bc57a3 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:00.965751 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cae1519b-ad58-4bb6-9fee-bdab00bc57a3 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:00.966348 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cae1519b-ad58-4bb6-9fee-bdab00bc57a3 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:01.157606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cae1519b-ad58-4bb6-9fee-bdab00bc57a3 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:01.165252 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cae1519b-ad58-4bb6-9fee-bdab00bc57a3 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.212834 Jan 11 14:15:01.165907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 167/372] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:00 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:01.377297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e85411a1-b82d-4530-87d5-8c29dfc966c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:01.381034 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e85411a1-b82d-4530-87d5-8c29dfc966c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:01.387291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e85411a1-b82d-4530-87d5-8c29dfc966c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:01.387768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e85411a1-b82d-4530-87d5-8c29dfc966c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:01.388562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e85411a1-b82d-4530-87d5-8c29dfc966c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:01.389001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e85411a1-b82d-4530-87d5-8c29dfc966c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:01.549640 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a5936502-6049-46ab-8bad-637a64acd69f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:01.550689 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a5936502-6049-46ab-8bad-637a64acd69f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:01.557349 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a5936502-6049-46ab-8bad-637a64acd69f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:01.557875 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a5936502-6049-46ab-8bad-637a64acd69f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:01.558665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a5936502-6049-46ab-8bad-637a64acd69f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:01.559099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a5936502-6049-46ab-8bad-637a64acd69f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:01.752654 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e85411a1-b82d-4530-87d5-8c29dfc966c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28597 microversion: 2.20 time: 0.379081 Jan 11 14:15:01.753310 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 206/373] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:01 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28597 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:01.758746 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-02f1e27b-6d49-454e-85b7-c1cecc2b9b13 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:01.759539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-02f1e27b-6d49-454e-85b7-c1cecc2b9b13 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:01.766725 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-02f1e27b-6d49-454e-85b7-c1cecc2b9b13 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:01.767257 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-02f1e27b-6d49-454e-85b7-c1cecc2b9b13 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:01.768326 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-02f1e27b-6d49-454e-85b7-c1cecc2b9b13 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:01.768780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-02f1e27b-6d49-454e-85b7-c1cecc2b9b13 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:01.819228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a5936502-6049-46ab-8bad-637a64acd69f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28568 microversion: 2.1 time: 0.272593 Jan 11 14:15:01.820905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 168/374] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:01 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:02.183414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cea7b7c6-b583-4b84-9555-95446866f15e tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:02.184216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cea7b7c6-b583-4b84-9555-95446866f15e tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:02.202065 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cea7b7c6-b583-4b84-9555-95446866f15e tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:02.202520 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cea7b7c6-b583-4b84-9555-95446866f15e tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:02.203317 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cea7b7c6-b583-4b84-9555-95446866f15e tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:02.204000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cea7b7c6-b583-4b84-9555-95446866f15e tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:02.238007 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-02f1e27b-6d49-454e-85b7-c1cecc2b9b13 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:02.247117 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-02f1e27b-6d49-454e-85b7-c1cecc2b9b13 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.492607 Jan 11 14:15:02.248068 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 207/375] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:01 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:02.437383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cea7b7c6-b583-4b84-9555-95446866f15e tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:02.445207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cea7b7c6-b583-4b84-9555-95446866f15e tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.266625 Jan 11 14:15:02.445781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 169/376] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:02 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:02.764769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-983e506b-9f64-4b0d-b7e8-849421d957aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:02.765804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-983e506b-9f64-4b0d-b7e8-849421d957aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:02.774907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-983e506b-9f64-4b0d-b7e8-849421d957aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:02.775414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-983e506b-9f64-4b0d-b7e8-849421d957aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:02.776353 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-983e506b-9f64-4b0d-b7e8-849421d957aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:02.776940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-983e506b-9f64-4b0d-b7e8-849421d957aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:02.832565 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8f6acece-e8be-4414-b779-c74b3553bb2f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:02.833561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8f6acece-e8be-4414-b779-c74b3553bb2f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:02.839898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f6acece-e8be-4414-b779-c74b3553bb2f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:02.840357 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f6acece-e8be-4414-b779-c74b3553bb2f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:02.841181 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f6acece-e8be-4414-b779-c74b3553bb2f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:02.841616 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f6acece-e8be-4414-b779-c74b3553bb2f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:02.881096 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-983e506b-9f64-4b0d-b7e8-849421d957aa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.120400 Jan 11 14:15:02.882049 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 208/377] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:02 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:03.153344 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8f6acece-e8be-4414-b779-c74b3553bb2f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.325126 Jan 11 14:15:03.154235 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 170/378] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:02 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:03.264914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cd474067-c638-4704-b3a3-1f16293f2609 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:03.265615 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cd474067-c638-4704-b3a3-1f16293f2609 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:03.272481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cd474067-c638-4704-b3a3-1f16293f2609 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:03.273172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cd474067-c638-4704-b3a3-1f16293f2609 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:03.273968 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cd474067-c638-4704-b3a3-1f16293f2609 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:03.274563 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cd474067-c638-4704-b3a3-1f16293f2609 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:03.413551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cd474067-c638-4704-b3a3-1f16293f2609 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:03.421872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cd474067-c638-4704-b3a3-1f16293f2609 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.161417 Jan 11 14:15:03.431324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 209/379] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:03 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:03.462744 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ada0bb12-53d7-48d8-90bb-5b0ef95857e1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:03.463433 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ada0bb12-53d7-48d8-90bb-5b0ef95857e1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:03.472220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ada0bb12-53d7-48d8-90bb-5b0ef95857e1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:03.472664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ada0bb12-53d7-48d8-90bb-5b0ef95857e1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:03.473446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ada0bb12-53d7-48d8-90bb-5b0ef95857e1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:03.474017 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ada0bb12-53d7-48d8-90bb-5b0ef95857e1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:03.613510 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ada0bb12-53d7-48d8-90bb-5b0ef95857e1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:03.620732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ada0bb12-53d7-48d8-90bb-5b0ef95857e1 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.161958 Jan 11 14:15:03.621287 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 171/380] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:03 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:03.893879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-843af90e-6ac4-4d23-afba-599f8b38fa03 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:03.894708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-843af90e-6ac4-4d23-afba-599f8b38fa03 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:03.900929 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-843af90e-6ac4-4d23-afba-599f8b38fa03 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:03.901376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-843af90e-6ac4-4d23-afba-599f8b38fa03 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:03.902723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-843af90e-6ac4-4d23-afba-599f8b38fa03 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:03.903157 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-843af90e-6ac4-4d23-afba-599f8b38fa03 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:03.971985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-843af90e-6ac4-4d23-afba-599f8b38fa03 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.081645 Jan 11 14:15:03.972621 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 210/381] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:03 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:04.165756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1948e2e0-7cca-4405-87a5-95f0adee014e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:04.166669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1948e2e0-7cca-4405-87a5-95f0adee014e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:04.173686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1948e2e0-7cca-4405-87a5-95f0adee014e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:04.174136 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1948e2e0-7cca-4405-87a5-95f0adee014e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:04.174911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1948e2e0-7cca-4405-87a5-95f0adee014e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:04.175346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1948e2e0-7cca-4405-87a5-95f0adee014e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:04.418759 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1948e2e0-7cca-4405-87a5-95f0adee014e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.256409 Jan 11 14:15:04.419310 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 172/382] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:04 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:04.439110 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-24d08caf-325d-4afb-9358-5e8522639e38 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:04.439876 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-24d08caf-325d-4afb-9358-5e8522639e38 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:04.446607 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-24d08caf-325d-4afb-9358-5e8522639e38 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:04.447085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-24d08caf-325d-4afb-9358-5e8522639e38 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:04.447930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-24d08caf-325d-4afb-9358-5e8522639e38 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:04.448634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-24d08caf-325d-4afb-9358-5e8522639e38 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:04.579306 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-24d08caf-325d-4afb-9358-5e8522639e38 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:04.586904 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-24d08caf-325d-4afb-9358-5e8522639e38 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.151776 Jan 11 14:15:04.587458 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 211/383] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:04 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:04.638023 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7a64833c-bcd2-422d-9b1e-a4e0d5e93223 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:04.638721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7a64833c-bcd2-422d-9b1e-a4e0d5e93223 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:04.647355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a64833c-bcd2-422d-9b1e-a4e0d5e93223 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:04.647890 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a64833c-bcd2-422d-9b1e-a4e0d5e93223 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:04.648794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a64833c-bcd2-422d-9b1e-a4e0d5e93223 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:04.649239 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a64833c-bcd2-422d-9b1e-a4e0d5e93223 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:04.787748 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7a64833c-bcd2-422d-9b1e-a4e0d5e93223 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:04.795378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7a64833c-bcd2-422d-9b1e-a4e0d5e93223 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.162357 Jan 11 14:15:04.795974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 173/384] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:04 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:04.983425 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f8764528-2c2c-4001-b6ba-de7ce8eb4e76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:04.984360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f8764528-2c2c-4001-b6ba-de7ce8eb4e76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:04.990412 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8764528-2c2c-4001-b6ba-de7ce8eb4e76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:04.990861 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8764528-2c2c-4001-b6ba-de7ce8eb4e76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:04.991658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8764528-2c2c-4001-b6ba-de7ce8eb4e76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:04.992088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8764528-2c2c-4001-b6ba-de7ce8eb4e76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:05.081463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f8764528-2c2c-4001-b6ba-de7ce8eb4e76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.102185 Jan 11 14:15:05.082097 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 212/385] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:04 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:05.430105 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7bb7c87d-8115-43d8-9e69-97da9079f6e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:05.431008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7bb7c87d-8115-43d8-9e69-97da9079f6e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:05.437632 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7bb7c87d-8115-43d8-9e69-97da9079f6e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:05.438073 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7bb7c87d-8115-43d8-9e69-97da9079f6e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:05.438840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7bb7c87d-8115-43d8-9e69-97da9079f6e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:05.439268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7bb7c87d-8115-43d8-9e69-97da9079f6e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:05.508988 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7bb7c87d-8115-43d8-9e69-97da9079f6e9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.082352 Jan 11 14:15:05.510443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 174/386] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:05 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:05.603766 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cb448b96-c9bf-4e2b-9fc7-8c9dcd419e18 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:05.604472 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cb448b96-c9bf-4e2b-9fc7-8c9dcd419e18 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:05.611679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb448b96-c9bf-4e2b-9fc7-8c9dcd419e18 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:05.612118 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb448b96-c9bf-4e2b-9fc7-8c9dcd419e18 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:05.612911 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb448b96-c9bf-4e2b-9fc7-8c9dcd419e18 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:05.613351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb448b96-c9bf-4e2b-9fc7-8c9dcd419e18 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:05.744565 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cb448b96-c9bf-4e2b-9fc7-8c9dcd419e18 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:05.752849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cb448b96-c9bf-4e2b-9fc7-8c9dcd419e18 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.153248 Jan 11 14:15:05.753415 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 213/387] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:05 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:05.812952 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2fb9f867-67f9-426c-9752-b813792ee25a tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:05.813677 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2fb9f867-67f9-426c-9752-b813792ee25a tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:05.820470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2fb9f867-67f9-426c-9752-b813792ee25a tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:05.820918 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2fb9f867-67f9-426c-9752-b813792ee25a tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:05.821697 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2fb9f867-67f9-426c-9752-b813792ee25a tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:05.822129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2fb9f867-67f9-426c-9752-b813792ee25a tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:05.955282 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2fb9f867-67f9-426c-9752-b813792ee25a tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:05.962451 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2fb9f867-67f9-426c-9752-b813792ee25a tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.153478 Jan 11 14:15:05.963019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 175/388] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:05 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:06.093417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ccb2f362-b328-437e-b4c3-41a56c4f6633 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:06.094348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ccb2f362-b328-437e-b4c3-41a56c4f6633 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:06.100719 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ccb2f362-b328-437e-b4c3-41a56c4f6633 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:06.101176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ccb2f362-b328-437e-b4c3-41a56c4f6633 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:06.101970 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ccb2f362-b328-437e-b4c3-41a56c4f6633 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:06.102437 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ccb2f362-b328-437e-b4c3-41a56c4f6633 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:06.182482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ccb2f362-b328-437e-b4c3-41a56c4f6633 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.093126 Jan 11 14:15:06.186463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 214/389] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:06 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:06.525034 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6b98cae5-3930-48d9-8789-51cc98091fa5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:06.526005 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6b98cae5-3930-48d9-8789-51cc98091fa5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:06.534009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6b98cae5-3930-48d9-8789-51cc98091fa5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:06.534465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6b98cae5-3930-48d9-8789-51cc98091fa5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:06.535282 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6b98cae5-3930-48d9-8789-51cc98091fa5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:06.535700 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6b98cae5-3930-48d9-8789-51cc98091fa5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:06.638164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6b98cae5-3930-48d9-8789-51cc98091fa5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.120722 Jan 11 14:15:06.642036 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 176/390] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:06 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:06.770962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a037fd5c-248e-4c1a-90d1-d566f7e2369f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:06.772320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a037fd5c-248e-4c1a-90d1-d566f7e2369f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:06.781699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a037fd5c-248e-4c1a-90d1-d566f7e2369f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:06.782226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a037fd5c-248e-4c1a-90d1-d566f7e2369f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:06.783226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a037fd5c-248e-4c1a-90d1-d566f7e2369f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:06.783768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a037fd5c-248e-4c1a-90d1-d566f7e2369f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:06.925211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a037fd5c-248e-4c1a-90d1-d566f7e2369f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:06.933292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a037fd5c-248e-4c1a-90d1-d566f7e2369f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.166328 Jan 11 14:15:06.933868 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 215/391] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:06 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:06.978543 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b03dcdd2-afde-4c8d-ae3a-cfc796d8bed4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:06.979392 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b03dcdd2-afde-4c8d-ae3a-cfc796d8bed4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:06.986173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b03dcdd2-afde-4c8d-ae3a-cfc796d8bed4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:06.986642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b03dcdd2-afde-4c8d-ae3a-cfc796d8bed4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:06.987452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b03dcdd2-afde-4c8d-ae3a-cfc796d8bed4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:06.987912 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b03dcdd2-afde-4c8d-ae3a-cfc796d8bed4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:07.121311 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b03dcdd2-afde-4c8d-ae3a-cfc796d8bed4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:07.128501 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b03dcdd2-afde-4c8d-ae3a-cfc796d8bed4 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.154123 Jan 11 14:15:07.129052 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 177/392] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:06 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:07.193321 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f9839def-1e41-4350-ba8d-dc72e3240ff3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:07.194240 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f9839def-1e41-4350-ba8d-dc72e3240ff3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:07.201263 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f9839def-1e41-4350-ba8d-dc72e3240ff3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:07.201717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f9839def-1e41-4350-ba8d-dc72e3240ff3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:07.202527 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f9839def-1e41-4350-ba8d-dc72e3240ff3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:07.202963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f9839def-1e41-4350-ba8d-dc72e3240ff3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:07.265369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f9839def-1e41-4350-ba8d-dc72e3240ff3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.075549 Jan 11 14:15:07.266001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 216/393] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:07 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:07.649126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c6ecdfc1-7f17-4ff3-ac51-e19b2644cba8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:07.650166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c6ecdfc1-7f17-4ff3-ac51-e19b2644cba8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:07.656959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c6ecdfc1-7f17-4ff3-ac51-e19b2644cba8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:07.657412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c6ecdfc1-7f17-4ff3-ac51-e19b2644cba8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:07.658369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c6ecdfc1-7f17-4ff3-ac51-e19b2644cba8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:07.658835 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c6ecdfc1-7f17-4ff3-ac51-e19b2644cba8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:07.744840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c6ecdfc1-7f17-4ff3-ac51-e19b2644cba8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.099103 Jan 11 14:15:07.745986 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 178/394] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:07 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:07.775034 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-619016422", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "60123190-3a8f-4b75-b7ad-1e70cf2044c8"}]}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:07.827443 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] validate_networks() for [('60123190-3a8f-4b75-b7ad-1e70cf2044c8', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:15:07.950989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3b2ca142-a26c-4e4e-9841-3859751479f9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:07.951714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3b2ca142-a26c-4e4e-9841-3859751479f9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:07.958752 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3b2ca142-a26c-4e4e-9841-3859751479f9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:07.959201 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3b2ca142-a26c-4e4e-9841-3859751479f9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:07.960021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3b2ca142-a26c-4e4e-9841-3859751479f9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:07.960461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3b2ca142-a26c-4e4e-9841-3859751479f9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:08.208707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3b2ca142-a26c-4e4e-9841-3859751479f9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:08.217652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3b2ca142-a26c-4e4e-9841-3859751479f9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.270593 Jan 11 14:15:08.217652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 179/395] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:07 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:08.221601 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-447367e0-f41d-4734-b409-1c758be09bb8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:08.222205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-447367e0-f41d-4734-b409-1c758be09bb8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:08.228281 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-447367e0-f41d-4734-b409-1c758be09bb8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:08.228901 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-447367e0-f41d-4734-b409-1c758be09bb8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:08.230217 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-447367e0-f41d-4734-b409-1c758be09bb8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:08.231154 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-447367e0-f41d-4734-b409-1c758be09bb8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:08.249752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:15:08.250211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:15:08.250632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:15:08.251038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:15:08.251448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:15:08.259981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:08.260453 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:08.261323 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:08.261782 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:08.278662 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Getting quotas for project b02bf5f593a54c658a76fff0246febf4. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:15:08.282661 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Getting quotas for user 23f705ed82e441229edd5a48b3797b32 and project b02bf5f593a54c658a76fff0246febf4. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:15:08.294018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:15:08.296470 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:15:08.347445 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4d497386-226b-4326-9d09-6376fc137e0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576300 Jan 11 14:15:08.351637 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 217/396] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:15:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:15:08.358492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-aff25a5a-2be3-4f99-b662-ab200aca5183 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:08.360113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-aff25a5a-2be3-4f99-b662-ab200aca5183 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:08.371636 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-447367e0-f41d-4734-b409-1c758be09bb8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:08.375140 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aff25a5a-2be3-4f99-b662-ab200aca5183 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:08.375140 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aff25a5a-2be3-4f99-b662-ab200aca5183 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:08.375871 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aff25a5a-2be3-4f99-b662-ab200aca5183 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:08.376558 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aff25a5a-2be3-4f99-b662-ab200aca5183 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:08.379120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-447367e0-f41d-4734-b409-1c758be09bb8 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.160816 Jan 11 14:15:08.379724 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 180/397] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:08 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:08.384478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-94276a58-ede8-4fe4-94ee-615b236e06dd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:08.385079 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-94276a58-ede8-4fe4-94ee-615b236e06dd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:08.437154 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-94276a58-ede8-4fe4-94ee-615b236e06dd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:08.444061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-94276a58-ede8-4fe4-94ee-615b236e06dd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1217 microversion: 2.1 time: 0.063382 Jan 11 14:15:08.444624 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 181/398] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:08 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:08.757121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-eb92d507-5521-4a0d-a6ff-2148974c0638 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:08.758042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-eb92d507-5521-4a0d-a6ff-2148974c0638 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:08.765415 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb92d507-5521-4a0d-a6ff-2148974c0638 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:08.765862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb92d507-5521-4a0d-a6ff-2148974c0638 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:08.766740 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb92d507-5521-4a0d-a6ff-2148974c0638 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:08.767078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb92d507-5521-4a0d-a6ff-2148974c0638 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:12.084001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-aff25a5a-2be3-4f99-b662-ab200aca5183 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 3.730385 Jan 11 14:15:12.085795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 218/399] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:08 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 3733 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:12.094789 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b3214eb0-2d7c-47d9-820a-a3e204ec3b1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:12.096330 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b3214eb0-2d7c-47d9-820a-a3e204ec3b1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:12.100850 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-eb92d507-5521-4a0d-a6ff-2148974c0638 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 3.347223 Jan 11 14:15:12.105958 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 182/400] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:08 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 3349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:12.109224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b3214eb0-2d7c-47d9-820a-a3e204ec3b1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:12.110039 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b3214eb0-2d7c-47d9-820a-a3e204ec3b1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:12.111451 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b3214eb0-2d7c-47d9-820a-a3e204ec3b1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:12.112284 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b3214eb0-2d7c-47d9-820a-a3e204ec3b1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:12.113271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a9ee749a-0c03-4c66-8607-5d344ed58251 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:12.113953 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a9ee749a-0c03-4c66-8607-5d344ed58251 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:12.121870 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a9ee749a-0c03-4c66-8607-5d344ed58251 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:12.122323 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a9ee749a-0c03-4c66-8607-5d344ed58251 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:12.123116 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a9ee749a-0c03-4c66-8607-5d344ed58251 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:12.123593 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a9ee749a-0c03-4c66-8607-5d344ed58251 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:12.314420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b3214eb0-2d7c-47d9-820a-a3e204ec3b1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:12.320762 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b3214eb0-2d7c-47d9-820a-a3e204ec3b1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.233118 Jan 11 14:15:12.321531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 219/401] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:12 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:12.321660 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a9ee749a-0c03-4c66-8607-5d344ed58251 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:12.325824 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f595e5db-0f75-4fb6-9c6b-66c96c252a2e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:12.326421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f595e5db-0f75-4fb6-9c6b-66c96c252a2e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:12.329666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a9ee749a-0c03-4c66-8607-5d344ed58251 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.221854 Jan 11 14:15:12.330523 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 183/402] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:12 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:12.332178 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f595e5db-0f75-4fb6-9c6b-66c96c252a2e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:12.332624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f595e5db-0f75-4fb6-9c6b-66c96c252a2e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:12.333400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f595e5db-0f75-4fb6-9c6b-66c96c252a2e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:12.333829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f595e5db-0f75-4fb6-9c6b-66c96c252a2e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:12.334808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-939cf15b-3d03-4b33-ac67-0de45d0ca0f6 req-f70d6df2-b9b8-4826-bd49-593e28cdac15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b9c6f8-3513-4858-b580-8f5a465cdcb0", "name": "network-vif-plugged", "status": "completed", "tag": "a8aea5d9-aedf-4c6e-954b-f6474f93a6d2"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:12.336374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:15:12.336374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:15:12.344676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-939cf15b-3d03-4b33-ac67-0de45d0ca0f6 req-f70d6df2-b9b8-4826-bd49-593e28cdac15 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:12.345638 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-939cf15b-3d03-4b33-ac67-0de45d0ca0f6 req-f70d6df2-b9b8-4826-bd49-593e28cdac15 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:12.362003 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-939cf15b-3d03-4b33-ac67-0de45d0ca0f6 req-f70d6df2-b9b8-4826-bd49-593e28cdac15 service nova] Creating event network-vif-plugged:a8aea5d9-aedf-4c6e-954b-f6474f93a6d2 for instance a6b9c6f8-3513-4858-b580-8f5a465cdcb0 on hv-cinder-82413 Jan 11 14:15:12.373162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-939cf15b-3d03-4b33-ac67-0de45d0ca0f6 req-f70d6df2-b9b8-4826-bd49-593e28cdac15 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035441 Jan 11 14:15:12.373162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 184/403] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:12.407159 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f595e5db-0f75-4fb6-9c6b-66c96c252a2e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:12.414472 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f595e5db-0f75-4fb6-9c6b-66c96c252a2e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1213 microversion: 2.1 time: 0.092206 Jan 11 14:15:12.415113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 220/404] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:12 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:13.098833 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cfc7be63-24a8-44fc-ad58-85897747c156 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:13.099767 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cfc7be63-24a8-44fc-ad58-85897747c156 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:13.106380 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cfc7be63-24a8-44fc-ad58-85897747c156 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:13.106939 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cfc7be63-24a8-44fc-ad58-85897747c156 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:13.107615 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cfc7be63-24a8-44fc-ad58-85897747c156 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:13.108049 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cfc7be63-24a8-44fc-ad58-85897747c156 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:13.113373 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9090ba5a-9e39-4a5a-acca-236faae873bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:13.114324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9090ba5a-9e39-4a5a-acca-236faae873bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:13.120705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9090ba5a-9e39-4a5a-acca-236faae873bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:13.121161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9090ba5a-9e39-4a5a-acca-236faae873bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:13.121959 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9090ba5a-9e39-4a5a-acca-236faae873bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:13.122420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9090ba5a-9e39-4a5a-acca-236faae873bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:13.834528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9090ba5a-9e39-4a5a-acca-236faae873bc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.724577 Jan 11 14:15:13.836924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 221/405] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:13 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:13.839257 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cfc7be63-24a8-44fc-ad58-85897747c156 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.744636 Jan 11 14:15:13.843244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e8c59c94-b726-41db-94a3-6f38b4c6d8d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:13.843833 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 185/406] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:13 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:13.844515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e8c59c94-b726-41db-94a3-6f38b4c6d8d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:13.849095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fc65265a-a63c-4873-81dc-0f855d19533f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:13.849796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fc65265a-a63c-4873-81dc-0f855d19533f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:13.851734 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8c59c94-b726-41db-94a3-6f38b4c6d8d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:13.852327 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8c59c94-b726-41db-94a3-6f38b4c6d8d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:13.853163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8c59c94-b726-41db-94a3-6f38b4c6d8d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:13.853730 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8c59c94-b726-41db-94a3-6f38b4c6d8d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:13.857853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc65265a-a63c-4873-81dc-0f855d19533f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:13.858447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc65265a-a63c-4873-81dc-0f855d19533f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:13.859583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc65265a-a63c-4873-81dc-0f855d19533f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:13.860078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc65265a-a63c-4873-81dc-0f855d19533f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:14.111921 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e8c59c94-b726-41db-94a3-6f38b4c6d8d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:14.117596 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fc65265a-a63c-4873-81dc-0f855d19533f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:14.119405 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e8c59c94-b726-41db-94a3-6f38b4c6d8d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.281058 Jan 11 14:15:14.120072 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 222/407] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:13 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:14.124900 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7702679f-f331-4a75-8822-6144f2e63bac tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:14.125502 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7702679f-f331-4a75-8822-6144f2e63bac tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:14.126879 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fc65265a-a63c-4873-81dc-0f855d19533f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.281769 Jan 11 14:15:14.128080 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 186/408] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:13 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:14.131287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7702679f-f331-4a75-8822-6144f2e63bac tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:14.131937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7702679f-f331-4a75-8822-6144f2e63bac tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:14.132723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7702679f-f331-4a75-8822-6144f2e63bac tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:14.133537 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7702679f-f331-4a75-8822-6144f2e63bac tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:14.192223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7702679f-f331-4a75-8822-6144f2e63bac tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:14.199390 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7702679f-f331-4a75-8822-6144f2e63bac tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1269 microversion: 2.1 time: 0.078339 Jan 11 14:15:14.199983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 223/409] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:14 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1269 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:14.848090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e4179517-4160-47f0-8fe6-dbedd0eb659e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:14.849009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e4179517-4160-47f0-8fe6-dbedd0eb659e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:14.851988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b1cdd96b-b615-4428-ac36-7840c980cd9f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:14.853049 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b1cdd96b-b615-4428-ac36-7840c980cd9f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:14.858425 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e4179517-4160-47f0-8fe6-dbedd0eb659e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:14.858897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e4179517-4160-47f0-8fe6-dbedd0eb659e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:14.859984 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e4179517-4160-47f0-8fe6-dbedd0eb659e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:14.860426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e4179517-4160-47f0-8fe6-dbedd0eb659e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:14.861025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b1cdd96b-b615-4428-ac36-7840c980cd9f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:14.861457 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b1cdd96b-b615-4428-ac36-7840c980cd9f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:14.862985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b1cdd96b-b615-4428-ac36-7840c980cd9f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:14.863435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b1cdd96b-b615-4428-ac36-7840c980cd9f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:15.155138 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e4179517-4160-47f0-8fe6-dbedd0eb659e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.312100 Jan 11 14:15:15.157711 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 187/410] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:14 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:15.166079 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4ab58b7f-239f-48f8-aca8-c1fe78718fca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:15.166969 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4ab58b7f-239f-48f8-aca8-c1fe78718fca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:15.174720 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b1cdd96b-b615-4428-ac36-7840c980cd9f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.325866 Jan 11 14:15:15.175883 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 224/411] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:14 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:15.177414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ab58b7f-239f-48f8-aca8-c1fe78718fca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:15.178388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ab58b7f-239f-48f8-aca8-c1fe78718fca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:15.180021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ab58b7f-239f-48f8-aca8-c1fe78718fca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:15.180685 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ab58b7f-239f-48f8-aca8-c1fe78718fca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:15.181702 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ce85166b-734a-4260-8eee-0ddd60a77b5f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:15.185412 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ce85166b-734a-4260-8eee-0ddd60a77b5f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:15.194114 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce85166b-734a-4260-8eee-0ddd60a77b5f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:15.194851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce85166b-734a-4260-8eee-0ddd60a77b5f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:15.196012 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce85166b-734a-4260-8eee-0ddd60a77b5f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:15.196546 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce85166b-734a-4260-8eee-0ddd60a77b5f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:15.512103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4ab58b7f-239f-48f8-aca8-c1fe78718fca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:15.521129 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ce85166b-734a-4260-8eee-0ddd60a77b5f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:15.526106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4ab58b7f-239f-48f8-aca8-c1fe78718fca tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.365448 Jan 11 14:15:15.527435 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 188/412] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:15 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:15.533157 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-de72db82-7ffa-485b-aaa9-3a5baf2af523 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:15.533991 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-de72db82-7ffa-485b-aaa9-3a5baf2af523 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:15.539301 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ce85166b-734a-4260-8eee-0ddd60a77b5f tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.362118 Jan 11 14:15:15.540176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 225/413] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:15 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:15.542141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de72db82-7ffa-485b-aaa9-3a5baf2af523 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:15.543133 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de72db82-7ffa-485b-aaa9-3a5baf2af523 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:15.544293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de72db82-7ffa-485b-aaa9-3a5baf2af523 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:15.544941 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de72db82-7ffa-485b-aaa9-3a5baf2af523 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:15.797423 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-de72db82-7ffa-485b-aaa9-3a5baf2af523 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:15.804794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-de72db82-7ffa-485b-aaa9-3a5baf2af523 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.275992 Jan 11 14:15:15.805359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 189/414] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:15 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:16.168393 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ce9c2171-f896-490e-8567-bb2a4b65d21f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:16.169459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ce9c2171-f896-490e-8567-bb2a4b65d21f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:16.176495 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce9c2171-f896-490e-8567-bb2a4b65d21f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.177081 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce9c2171-f896-490e-8567-bb2a4b65d21f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.177715 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce9c2171-f896-490e-8567-bb2a4b65d21f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.178146 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce9c2171-f896-490e-8567-bb2a4b65d21f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.186006 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b2210da6-a8d0-4c9d-bb19-0a2262d6fd1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:16.188005 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b2210da6-a8d0-4c9d-bb19-0a2262d6fd1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:16.194235 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2210da6-a8d0-4c9d-bb19-0a2262d6fd1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.194820 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2210da6-a8d0-4c9d-bb19-0a2262d6fd1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.195734 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2210da6-a8d0-4c9d-bb19-0a2262d6fd1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.196255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2210da6-a8d0-4c9d-bb19-0a2262d6fd1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.301850 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b2210da6-a8d0-4c9d-bb19-0a2262d6fd1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.119102 Jan 11 14:15:16.302443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 190/415] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:16 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:16.312543 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-953881e8-5546-45c8-9c44-e9559d4c978a req-3843d81c-ee60-4a07-9606-52f37f8f1e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57149afd-9a49-4af4-8197-c218a8c0846c", "tag": "16deb647-6c63-414a-a191-4b93e1d0501e"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:16.314240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:15:16.314240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:15:16.314482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ce9c2171-f896-490e-8567-bb2a4b65d21f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.150331 Jan 11 14:15:16.315197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 226/416] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:16 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:16.321884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-953881e8-5546-45c8-9c44-e9559d4c978a req-3843d81c-ee60-4a07-9606-52f37f8f1e57 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.322359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-953881e8-5546-45c8-9c44-e9559d4c978a req-3843d81c-ee60-4a07-9606-52f37f8f1e57 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.333080 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-953881e8-5546-45c8-9c44-e9559d4c978a req-3843d81c-ee60-4a07-9606-52f37f8f1e57 service nova] Creating event network-changed:16deb647-6c63-414a-a191-4b93e1d0501e for instance 57149afd-9a49-4af4-8197-c218a8c0846c on hv-cinder-82413 Jan 11 14:15:16.337619 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-953881e8-5546-45c8-9c44-e9559d4c978a req-3843d81c-ee60-4a07-9606-52f37f8f1e57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029470 Jan 11 14:15:16.338244 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 191/417] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:16.545667 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0720fd9a-d174-448b-ab90-9db2ce2c87ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:16.546366 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0720fd9a-d174-448b-ab90-9db2ce2c87ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:16.553216 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0720fd9a-d174-448b-ab90-9db2ce2c87ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.553583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0720fd9a-d174-448b-ab90-9db2ce2c87ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.554359 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0720fd9a-d174-448b-ab90-9db2ce2c87ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.560827 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0720fd9a-d174-448b-ab90-9db2ce2c87ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.561127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b55caec6-2713-4596-827d-47ba082baf99 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:16.561127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b55caec6-2713-4596-827d-47ba082baf99 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:16.566238 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b55caec6-2713-4596-827d-47ba082baf99 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.566790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b55caec6-2713-4596-827d-47ba082baf99 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.567606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b55caec6-2713-4596-827d-47ba082baf99 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.568039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b55caec6-2713-4596-827d-47ba082baf99 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.817978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0720fd9a-d174-448b-ab90-9db2ce2c87ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:16.828160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0720fd9a-d174-448b-ab90-9db2ce2c87ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.287020 Jan 11 14:15:16.829098 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 227/418] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:16 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:16.834676 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cc7e63a0-f315-41f5-9eb1-0da4db33c723 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:16.835739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cc7e63a0-f315-41f5-9eb1-0da4db33c723 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:16.845311 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cc7e63a0-f315-41f5-9eb1-0da4db33c723 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.846208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cc7e63a0-f315-41f5-9eb1-0da4db33c723 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.847077 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cc7e63a0-f315-41f5-9eb1-0da4db33c723 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:16.847623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cc7e63a0-f315-41f5-9eb1-0da4db33c723 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:16.866875 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b55caec6-2713-4596-827d-47ba082baf99 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:16.880514 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b55caec6-2713-4596-827d-47ba082baf99 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1314 microversion: 2.1 time: 0.327242 Jan 11 14:15:16.881446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 192/419] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:16 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:17.314817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c13a4211-bb20-4c43-8834-d537af9d0a5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:17.315763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c13a4211-bb20-4c43-8834-d537af9d0a5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:17.323726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c13a4211-bb20-4c43-8834-d537af9d0a5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:17.324287 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c13a4211-bb20-4c43-8834-d537af9d0a5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:17.325079 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c13a4211-bb20-4c43-8834-d537af9d0a5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:17.325512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c13a4211-bb20-4c43-8834-d537af9d0a5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:17.325703 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cc7e63a0-f315-41f5-9eb1-0da4db33c723 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:17.334151 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cc7e63a0-f315-41f5-9eb1-0da4db33c723 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.503813 Jan 11 14:15:17.335389 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 228/420] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:16 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:17.342277 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7cc0a5f2-df9e-4795-9319-2ca28eb448d5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:17.344562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7cc0a5f2-df9e-4795-9319-2ca28eb448d5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:17.351464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7cc0a5f2-df9e-4795-9319-2ca28eb448d5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:17.352237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7cc0a5f2-df9e-4795-9319-2ca28eb448d5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:17.354112 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7cc0a5f2-df9e-4795-9319-2ca28eb448d5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:17.354650 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7cc0a5f2-df9e-4795-9319-2ca28eb448d5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:17.730720 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c13a4211-bb20-4c43-8834-d537af9d0a5a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.418840 Jan 11 14:15:17.731417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 193/421] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:17 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:17.759746 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7cc0a5f2-df9e-4795-9319-2ca28eb448d5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.422136 Jan 11 14:15:17.760555 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 229/422] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:17 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:17.846308 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3ec43252-da61-4bad-86ac-21ea0aae4ae8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:17.847043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3ec43252-da61-4bad-86ac-21ea0aae4ae8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:17.854042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ec43252-da61-4bad-86ac-21ea0aae4ae8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:17.854676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ec43252-da61-4bad-86ac-21ea0aae4ae8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:17.856295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ec43252-da61-4bad-86ac-21ea0aae4ae8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:17.856734 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ec43252-da61-4bad-86ac-21ea0aae4ae8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:17.902348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-feeab59d-c216-4410-a440-7e3082715864 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:17.903305 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-feeab59d-c216-4410-a440-7e3082715864 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:17.913922 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-feeab59d-c216-4410-a440-7e3082715864 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:17.914623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-feeab59d-c216-4410-a440-7e3082715864 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:17.915742 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-feeab59d-c216-4410-a440-7e3082715864 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:17.916349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-feeab59d-c216-4410-a440-7e3082715864 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.127741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3ec43252-da61-4bad-86ac-21ea0aae4ae8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:18.135758 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3ec43252-da61-4bad-86ac-21ea0aae4ae8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.293848 Jan 11 14:15:18.136761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 194/423] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:17 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:18.230349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-feeab59d-c216-4410-a440-7e3082715864 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:18.238354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-feeab59d-c216-4410-a440-7e3082715864 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1497 microversion: 2.1 time: 0.342847 Jan 11 14:15:18.238926 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 230/424] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:17 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1497 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:18.351739 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-05b8f780-f179-4fa3-ae86-82811a0f275b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:18.352948 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-05b8f780-f179-4fa3-ae86-82811a0f275b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:18.373075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-05b8f780-f179-4fa3-ae86-82811a0f275b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.373561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-05b8f780-f179-4fa3-ae86-82811a0f275b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.374401 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-05b8f780-f179-4fa3-ae86-82811a0f275b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.374840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-05b8f780-f179-4fa3-ae86-82811a0f275b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.566587 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-05b8f780-f179-4fa3-ae86-82811a0f275b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:18.576443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-05b8f780-f179-4fa3-ae86-82811a0f275b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.229396 Jan 11 14:15:18.577185 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 195/425] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:18 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:18.664369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8cd5ece3-f797-4ab9-bb47-4ca506f4c6d2 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93eb2567-048f-4a7a-990e-d855804defe5", "device": "/dev/sdb"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:18.666512 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8cd5ece3-f797-4ab9-bb47-4ca506f4c6d2 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:18.674045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8cd5ece3-f797-4ab9-bb47-4ca506f4c6d2 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.674499 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8cd5ece3-f797-4ab9-bb47-4ca506f4c6d2 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.675278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8cd5ece3-f797-4ab9-bb47-4ca506f4c6d2 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.675748 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8cd5ece3-f797-4ab9-bb47-4ca506f4c6d2 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.715688 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fc9859f7-8c08-42d6-abc3-9e5b6d0f39ce tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:18.717469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fc9859f7-8c08-42d6-abc3-9e5b6d0f39ce tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:18.727312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc9859f7-8c08-42d6-abc3-9e5b6d0f39ce tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.728113 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc9859f7-8c08-42d6-abc3-9e5b6d0f39ce tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.728995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc9859f7-8c08-42d6-abc3-9e5b6d0f39ce tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.729637 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc9859f7-8c08-42d6-abc3-9e5b6d0f39ce tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.757792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fc9859f7-8c08-42d6-abc3-9e5b6d0f39ce tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Going to try to terminate instance {{(pid=116475) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:15:18.861420 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fc9859f7-8c08-42d6-abc3-9e5b6d0f39ce tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 204 len: 0 microversion: 2.1 time: 0.150510 Jan 11 14:15:18.862222 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 196/426] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:15:18 2022] DELETE /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:15:18.868883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0f33fb96-c1d0-4f81-b59a-766fd0493f9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:18.869939 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0f33fb96-c1d0-4f81-b59a-766fd0493f9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:18.876675 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f33fb96-c1d0-4f81-b59a-766fd0493f9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.877340 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f33fb96-c1d0-4f81-b59a-766fd0493f9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.878074 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f33fb96-c1d0-4f81-b59a-766fd0493f9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.878511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f33fb96-c1d0-4f81-b59a-766fd0493f9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.951693 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8cd5ece3-f797-4ab9-bb47-4ca506f4c6d2 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "POST /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290830 Jan 11 14:15:18.952318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 231/427] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:15:18 2022] POST /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:18.957896 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-089e4024-690e-47a2-8d62-d45a3d0a4ad8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:18.959079 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-089e4024-690e-47a2-8d62-d45a3d0a4ad8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:18.970883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0f33fb96-c1d0-4f81-b59a-766fd0493f9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.106351 Jan 11 14:15:18.975269 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 197/428] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:18 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:18.981013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-089e4024-690e-47a2-8d62-d45a3d0a4ad8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.981185 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-836a51a3-96b5-4e9a-9898-7c28392667c0 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:18.981722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-836a51a3-96b5-4e9a-9898-7c28392667c0 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:18.981873 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-089e4024-690e-47a2-8d62-d45a3d0a4ad8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.983148 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-089e4024-690e-47a2-8d62-d45a3d0a4ad8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.983740 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-089e4024-690e-47a2-8d62-d45a3d0a4ad8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.991181 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-836a51a3-96b5-4e9a-9898-7c28392667c0 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.991921 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-836a51a3-96b5-4e9a-9898-7c28392667c0 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:18.992716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-836a51a3-96b5-4e9a-9898-7c28392667c0 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:18.993171 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-836a51a3-96b5-4e9a-9898-7c28392667c0 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:19.146239 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-836a51a3-96b5-4e9a-9898-7c28392667c0 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:19.154681 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-836a51a3-96b5-4e9a-9898-7c28392667c0 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1503 microversion: 2.1 time: 0.178201 Jan 11 14:15:19.155242 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 198/429] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:18 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:19.159429 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-08407363-c6f5-4a20-b5f9-a4431bb6c310 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:19.160260 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-08407363-c6f5-4a20-b5f9-a4431bb6c310 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:19.165935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08407363-c6f5-4a20-b5f9-a4431bb6c310 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:19.166382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08407363-c6f5-4a20-b5f9-a4431bb6c310 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:19.167153 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08407363-c6f5-4a20-b5f9-a4431bb6c310 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:19.167668 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08407363-c6f5-4a20-b5f9-a4431bb6c310 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:19.271684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-089e4024-690e-47a2-8d62-d45a3d0a4ad8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.317801 Jan 11 14:15:19.275572 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 232/430] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:18 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:19.303162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-08407363-c6f5-4a20-b5f9-a4431bb6c310 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:19.311417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-08407363-c6f5-4a20-b5f9-a4431bb6c310 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.155130 Jan 11 14:15:19.312564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 199/431] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:19 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:19.592454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b196deea-066d-481a-bb7e-9d1fab445b77 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:19.593149 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b196deea-066d-481a-bb7e-9d1fab445b77 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:19.600260 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b196deea-066d-481a-bb7e-9d1fab445b77 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:19.600707 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b196deea-066d-481a-bb7e-9d1fab445b77 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:19.601488 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b196deea-066d-481a-bb7e-9d1fab445b77 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:19.601938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b196deea-066d-481a-bb7e-9d1fab445b77 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:19.760743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b196deea-066d-481a-bb7e-9d1fab445b77 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:19.768837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b196deea-066d-481a-bb7e-9d1fab445b77 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.179688 Jan 11 14:15:19.769774 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 233/432] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:19 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:19.982883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8f0c8198-40b3-4e08-be84-56350535a7e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:19.983874 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8f0c8198-40b3-4e08-be84-56350535a7e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:19.990114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f0c8198-40b3-4e08-be84-56350535a7e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:19.990566 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f0c8198-40b3-4e08-be84-56350535a7e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:19.991344 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f0c8198-40b3-4e08-be84-56350535a7e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:19.991806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f0c8198-40b3-4e08-be84-56350535a7e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.171859 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-37efc99e-0d7e-4bb1-8411-1cc043311f45 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:20.172483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-37efc99e-0d7e-4bb1-8411-1cc043311f45 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:20.179529 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-37efc99e-0d7e-4bb1-8411-1cc043311f45 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.179906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-37efc99e-0d7e-4bb1-8411-1cc043311f45 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.180708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-37efc99e-0d7e-4bb1-8411-1cc043311f45 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.181144 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-37efc99e-0d7e-4bb1-8411-1cc043311f45 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.211326 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8f0c8198-40b3-4e08-be84-56350535a7e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.232531 Jan 11 14:15:20.213203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 200/433] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:19 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:20.284232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8b3efdd2-7685-4b30-b66a-74b84f3593d0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:20.285290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8b3efdd2-7685-4b30-b66a-74b84f3593d0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:20.292876 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8b3efdd2-7685-4b30-b66a-74b84f3593d0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.293380 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8b3efdd2-7685-4b30-b66a-74b84f3593d0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.294402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8b3efdd2-7685-4b30-b66a-74b84f3593d0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.294997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8b3efdd2-7685-4b30-b66a-74b84f3593d0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.322988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-37efc99e-0d7e-4bb1-8411-1cc043311f45 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:20.332573 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-37efc99e-0d7e-4bb1-8411-1cc043311f45 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1503 microversion: 2.1 time: 0.164498 Jan 11 14:15:20.333131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 234/434] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:20 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:20.337793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1bc7f3e4-360e-420f-9061-8fdec88bdcda tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:20.338397 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1bc7f3e4-360e-420f-9061-8fdec88bdcda tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:20.344768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1bc7f3e4-360e-420f-9061-8fdec88bdcda tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.345215 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1bc7f3e4-360e-420f-9061-8fdec88bdcda tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.345995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1bc7f3e4-360e-420f-9061-8fdec88bdcda tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.346427 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1bc7f3e4-360e-420f-9061-8fdec88bdcda tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.410789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8b3efdd2-7685-4b30-b66a-74b84f3593d0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.131027 Jan 11 14:15:20.411428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 201/435] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:20 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:20.478078 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1bc7f3e4-360e-420f-9061-8fdec88bdcda tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:20.485878 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1bc7f3e4-360e-420f-9061-8fdec88bdcda tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1501 microversion: 2.1 time: 0.151796 Jan 11 14:15:20.486434 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 235/436] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:20 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:20.502345 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80b8b1dc-1ab0-4f4b-be3b-a2b0a0328f9e"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:20.503477 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:20.510136 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.510586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.511361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.511816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.535140 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] HTTP exception thrown: Cannot 'attach_volume' instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 while it is in vm_state rescued Jan 11 14:15:20.535740 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Returning 409 to user: Cannot 'attach_volume' instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 while it is in vm_state rescued {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:15:20.536552 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cdbb02d0-13da-4251-98de-62bf001c5316 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038368 Jan 11 14:15:20.537082 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 202/437] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:15:20 2022] POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 11 14:15:20.545934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2a0d8180-1ecf-4dc1-b95a-eb1127351764 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:20.546465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2a0d8180-1ecf-4dc1-b95a-eb1127351764 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:20.552294 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a0d8180-1ecf-4dc1-b95a-eb1127351764 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.552740 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a0d8180-1ecf-4dc1-b95a-eb1127351764 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.553512 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a0d8180-1ecf-4dc1-b95a-eb1127351764 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.553947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a0d8180-1ecf-4dc1-b95a-eb1127351764 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.616703 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2a0d8180-1ecf-4dc1-b95a-eb1127351764 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/action" status: 202 len: 0 microversion: 2.1 time: 0.074850 Jan 11 14:15:20.618197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 236/438] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:20 2022] POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:20.626220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4dca51f7-6ac5-40ec-9f14-0cf5992b3d4f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:20.626834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4dca51f7-6ac5-40ec-9f14-0cf5992b3d4f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:20.633458 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4dca51f7-6ac5-40ec-9f14-0cf5992b3d4f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.633905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4dca51f7-6ac5-40ec-9f14-0cf5992b3d4f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.634689 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4dca51f7-6ac5-40ec-9f14-0cf5992b3d4f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.635125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4dca51f7-6ac5-40ec-9f14-0cf5992b3d4f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.786308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-05a34d98-9fbf-4858-a3b6-da8164b116e5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:20.787003 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-05a34d98-9fbf-4858-a3b6-da8164b116e5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:20.792935 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-05a34d98-9fbf-4858-a3b6-da8164b116e5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.793386 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-05a34d98-9fbf-4858-a3b6-da8164b116e5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.794159 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-05a34d98-9fbf-4858-a3b6-da8164b116e5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:20.794593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-05a34d98-9fbf-4858-a3b6-da8164b116e5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:20.889755 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4dca51f7-6ac5-40ec-9f14-0cf5992b3d4f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:20.897695 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4dca51f7-6ac5-40ec-9f14-0cf5992b3d4f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1509 microversion: 2.1 time: 0.275160 Jan 11 14:15:20.898249 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 203/439] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:20 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:21.036722 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-05a34d98-9fbf-4858-a3b6-da8164b116e5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:21.044610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-05a34d98-9fbf-4858-a3b6-da8164b116e5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.262229 Jan 11 14:15:21.045211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 237/440] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:20 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:21.224072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-04fd7653-22a0-4cbf-8f22-10ecb9f07ec6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:21.224986 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-04fd7653-22a0-4cbf-8f22-10ecb9f07ec6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:21.231238 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-04fd7653-22a0-4cbf-8f22-10ecb9f07ec6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:21.231803 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-04fd7653-22a0-4cbf-8f22-10ecb9f07ec6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:21.233318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-04fd7653-22a0-4cbf-8f22-10ecb9f07ec6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:21.233318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-04fd7653-22a0-4cbf-8f22-10ecb9f07ec6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:21.309764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-04fd7653-22a0-4cbf-8f22-10ecb9f07ec6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.089178 Jan 11 14:15:21.310412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 204/441] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:21 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:21.349614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-29c640c2-0631-4e90-aca2-530fbb024625 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:21.350218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-29c640c2-0631-4e90-aca2-530fbb024625 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:21.356120 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-29c640c2-0631-4e90-aca2-530fbb024625 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:21.356573 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-29c640c2-0631-4e90-aca2-530fbb024625 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:21.357348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-29c640c2-0631-4e90-aca2-530fbb024625 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:21.357780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-29c640c2-0631-4e90-aca2-530fbb024625 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:21.422953 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4461d2c4-c84f-4a08-b5b6-62d6fdb1da30 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:21.424157 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4461d2c4-c84f-4a08-b5b6-62d6fdb1da30 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:21.431102 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4461d2c4-c84f-4a08-b5b6-62d6fdb1da30 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:21.431667 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4461d2c4-c84f-4a08-b5b6-62d6fdb1da30 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:21.432458 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4461d2c4-c84f-4a08-b5b6-62d6fdb1da30 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:21.433437 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4461d2c4-c84f-4a08-b5b6-62d6fdb1da30 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:21.489075 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-29c640c2-0631-4e90-aca2-530fbb024625 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:21.496891 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-29c640c2-0631-4e90-aca2-530fbb024625 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1503 microversion: 2.1 time: 0.150958 Jan 11 14:15:21.497441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 238/442] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:21 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:21.548858 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4461d2c4-c84f-4a08-b5b6-62d6fdb1da30 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.129815 Jan 11 14:15:21.549494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 205/443] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:21 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:21.915829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-69f94f2f-57ac-415e-88c2-5b7756781c0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:21.916444 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-69f94f2f-57ac-415e-88c2-5b7756781c0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:21.922789 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69f94f2f-57ac-415e-88c2-5b7756781c0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:21.923233 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69f94f2f-57ac-415e-88c2-5b7756781c0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:21.924038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69f94f2f-57ac-415e-88c2-5b7756781c0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:21.924469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69f94f2f-57ac-415e-88c2-5b7756781c0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.066144 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fdc4c2ff-49ab-45a9-b852-e07fa3716efc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:22.066144 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fdc4c2ff-49ab-45a9-b852-e07fa3716efc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:22.071017 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fdc4c2ff-49ab-45a9-b852-e07fa3716efc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.071462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fdc4c2ff-49ab-45a9-b852-e07fa3716efc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.072289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fdc4c2ff-49ab-45a9-b852-e07fa3716efc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.072720 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fdc4c2ff-49ab-45a9-b852-e07fa3716efc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.116872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-69f94f2f-57ac-415e-88c2-5b7756781c0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:22.126568 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-69f94f2f-57ac-415e-88c2-5b7756781c0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1509 microversion: 2.1 time: 0.214088 Jan 11 14:15:22.136039 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 239/444] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:21 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:22.237869 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-95f9dea8-5d89-4e06-aff4-a1dd58173f51 req-3bf72295-59f5-4507-b20e-2c2ee37f3b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b9c6f8-3513-4858-b580-8f5a465cdcb0", "name": "network-vif-deleted", "tag": "a8aea5d9-aedf-4c6e-954b-f6474f93a6d2"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:22.239789 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:15:22.239789 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:15:22.247098 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-95f9dea8-5d89-4e06-aff4-a1dd58173f51 req-3bf72295-59f5-4507-b20e-2c2ee37f3b50 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.247561 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-95f9dea8-5d89-4e06-aff4-a1dd58173f51 req-3bf72295-59f5-4507-b20e-2c2ee37f3b50 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.270045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-95f9dea8-5d89-4e06-aff4-a1dd58173f51 req-3bf72295-59f5-4507-b20e-2c2ee37f3b50 service nova] Creating event network-vif-deleted:a8aea5d9-aedf-4c6e-954b-f6474f93a6d2 for instance a6b9c6f8-3513-4858-b580-8f5a465cdcb0 on hv-cinder-82413 Jan 11 14:15:22.274776 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-95f9dea8-5d89-4e06-aff4-a1dd58173f51 req-3bf72295-59f5-4507-b20e-2c2ee37f3b50 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040686 Jan 11 14:15:22.275401 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 240/445] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:15:22.308098 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fdc4c2ff-49ab-45a9-b852-e07fa3716efc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:22.318056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fdc4c2ff-49ab-45a9-b852-e07fa3716efc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.260424 Jan 11 14:15:22.318559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 206/446] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:22 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:22.322228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d251fe0e-13e3-4240-86be-0dee5b55420f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:22.324364 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d251fe0e-13e3-4240-86be-0dee5b55420f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:22.331390 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d251fe0e-13e3-4240-86be-0dee5b55420f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.332080 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d251fe0e-13e3-4240-86be-0dee5b55420f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.332894 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d251fe0e-13e3-4240-86be-0dee5b55420f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.333325 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d251fe0e-13e3-4240-86be-0dee5b55420f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.422961 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d251fe0e-13e3-4240-86be-0dee5b55420f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.105234 Jan 11 14:15:22.423616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 241/447] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:22 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:22.513775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:22.514383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:22.520615 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.521063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.521840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.522274 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.551682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.552127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.552571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lazy-loading 'fault' on Instance uuid a6b9c6f8-3513-4858-b580-8f5a465cdcb0 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:15:22.560486 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b7b95abb-83da-47dc-9c9d-8a7f5491c738 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:22.561500 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b7b95abb-83da-47dc-9c9d-8a7f5491c738 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:22.568290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7b95abb-83da-47dc-9c9d-8a7f5491c738 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.568668 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7b95abb-83da-47dc-9c9d-8a7f5491c738 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.569438 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7b95abb-83da-47dc-9c9d-8a7f5491c738 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:22.569867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7b95abb-83da-47dc-9c9d-8a7f5491c738 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:22.592080 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951e83a1eae43f4a8f9b3ebebc23350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee5ce1ef8d4f0ba4a225c91b7f6d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:22.600305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9e8c640b-6f3c-4a65-9f0f-aee1d4eed099 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 200 len: 1304 microversion: 2.1 time: 0.090703 Jan 11 14:15:22.600866 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 207/448] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:22 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:22.641195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b7b95abb-83da-47dc-9c9d-8a7f5491c738 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.084516 Jan 11 14:15:22.641823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 242/449] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:22 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:23.143021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1ee79691-6f9c-42ae-b2b4-e5daf0134a8a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:23.143559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1ee79691-6f9c-42ae-b2b4-e5daf0134a8a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:23.149721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1ee79691-6f9c-42ae-b2b4-e5daf0134a8a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.150161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1ee79691-6f9c-42ae-b2b4-e5daf0134a8a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.150929 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1ee79691-6f9c-42ae-b2b4-e5daf0134a8a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.151363 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1ee79691-6f9c-42ae-b2b4-e5daf0134a8a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.278502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1ee79691-6f9c-42ae-b2b4-e5daf0134a8a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:23.285645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1ee79691-6f9c-42ae-b2b4-e5daf0134a8a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1509 microversion: 2.1 time: 0.146344 Jan 11 14:15:23.286206 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 208/450] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:23 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:23.335328 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-50f5bce3-165d-481e-8f87-39659ca1fbdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:23.336063 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-50f5bce3-165d-481e-8f87-39659ca1fbdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:23.343387 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-50f5bce3-165d-481e-8f87-39659ca1fbdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.343859 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-50f5bce3-165d-481e-8f87-39659ca1fbdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.344635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-50f5bce3-165d-481e-8f87-39659ca1fbdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.345068 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-50f5bce3-165d-481e-8f87-39659ca1fbdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.434116 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ab8d6e81-7e99-4f7d-869a-f54d9e19cf3c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:23.435004 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ab8d6e81-7e99-4f7d-869a-f54d9e19cf3c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:23.440842 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ab8d6e81-7e99-4f7d-869a-f54d9e19cf3c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.441292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ab8d6e81-7e99-4f7d-869a-f54d9e19cf3c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.442073 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ab8d6e81-7e99-4f7d-869a-f54d9e19cf3c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.442509 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ab8d6e81-7e99-4f7d-869a-f54d9e19cf3c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.480812 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-50f5bce3-165d-481e-8f87-39659ca1fbdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:23.487952 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-50f5bce3-165d-481e-8f87-39659ca1fbdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.156599 Jan 11 14:15:23.488514 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 243/451] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:23 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:23.520478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ab8d6e81-7e99-4f7d-869a-f54d9e19cf3c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.089901 Jan 11 14:15:23.521303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 209/452] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:23 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:23.617059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:23.617803 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] [instance: a6b9c6f8-3513-4858-b580-8f5a465cdcb0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:23.624174 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.624615 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.625392 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.625821 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.638772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] HTTP exception thrown: Instance a6b9c6f8-3513-4858-b580-8f5a465cdcb0 could not be found. Jan 11 14:15:23.639351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] Returning 404 to user: Instance a6b9c6f8-3513-4858-b580-8f5a465cdcb0 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:15:23.640184 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bea2705d-3680-412a-aabb-2e9c04387808 tempest-VolumesActionsTest-2065892254 tempest-VolumesActionsTest-2065892254-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0" status: 404 len: 111 microversion: 2.1 time: 0.026939 Jan 11 14:15:23.640693 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 244/453] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:23 2022] GET /compute/v2.1/servers/a6b9c6f8-3513-4858-b580-8f5a465cdcb0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:15:23.652823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-050cd697-228c-428c-84a3-6a8fe5e7e856 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:23.653821 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-050cd697-228c-428c-84a3-6a8fe5e7e856 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:23.660806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-050cd697-228c-428c-84a3-6a8fe5e7e856 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.661267 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-050cd697-228c-428c-84a3-6a8fe5e7e856 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.662057 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-050cd697-228c-428c-84a3-6a8fe5e7e856 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:23.662502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-050cd697-228c-428c-84a3-6a8fe5e7e856 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:23.738778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-050cd697-228c-428c-84a3-6a8fe5e7e856 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.090297 Jan 11 14:15:23.739457 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 210/454] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:23 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:24.302927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-275f1bce-6823-462f-bab1-89bab4a87de4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:24.303475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-275f1bce-6823-462f-bab1-89bab4a87de4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:24.310212 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-275f1bce-6823-462f-bab1-89bab4a87de4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:24.310664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-275f1bce-6823-462f-bab1-89bab4a87de4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:24.311449 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-275f1bce-6823-462f-bab1-89bab4a87de4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:24.311972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-275f1bce-6823-462f-bab1-89bab4a87de4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:24.443432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-275f1bce-6823-462f-bab1-89bab4a87de4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:24.451993 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-275f1bce-6823-462f-bab1-89bab4a87de4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1509 microversion: 2.1 time: 0.153540 Jan 11 14:15:24.452483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 245/455] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:24 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:24.504699 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b8682290-11d4-44f9-a4e7-f63f0420efcd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:24.505397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b8682290-11d4-44f9-a4e7-f63f0420efcd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:24.512684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8682290-11d4-44f9-a4e7-f63f0420efcd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:24.513133 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8682290-11d4-44f9-a4e7-f63f0420efcd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:24.513942 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8682290-11d4-44f9-a4e7-f63f0420efcd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:24.514372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8682290-11d4-44f9-a4e7-f63f0420efcd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:24.531413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5c5dc5ff-c20c-4c84-8671-b99f794d3d4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:24.532349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5c5dc5ff-c20c-4c84-8671-b99f794d3d4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:24.538005 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5c5dc5ff-c20c-4c84-8671-b99f794d3d4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:24.538741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5c5dc5ff-c20c-4c84-8671-b99f794d3d4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:24.539542 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5c5dc5ff-c20c-4c84-8671-b99f794d3d4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:24.539972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5c5dc5ff-c20c-4c84-8671-b99f794d3d4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:24.627833 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5c5dc5ff-c20c-4c84-8671-b99f794d3d4b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.099997 Jan 11 14:15:24.631739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 246/456] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:24 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:24.645595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b8682290-11d4-44f9-a4e7-f63f0420efcd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:24.653194 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b8682290-11d4-44f9-a4e7-f63f0420efcd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.152517 Jan 11 14:15:24.653745 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 211/457] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:24 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:24.751086 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b5251cb4-4226-44a4-ac91-5acaf5fcff95 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:24.752144 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b5251cb4-4226-44a4-ac91-5acaf5fcff95 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:24.758911 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b5251cb4-4226-44a4-ac91-5acaf5fcff95 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:24.759360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b5251cb4-4226-44a4-ac91-5acaf5fcff95 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:24.760159 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b5251cb4-4226-44a4-ac91-5acaf5fcff95 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:24.760592 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b5251cb4-4226-44a4-ac91-5acaf5fcff95 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:25.470313 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8a53aae6-90cb-45bf-b391-b29b41f35e3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:25.470915 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8a53aae6-90cb-45bf-b391-b29b41f35e3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:25.477110 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8a53aae6-90cb-45bf-b391-b29b41f35e3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:25.477548 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8a53aae6-90cb-45bf-b391-b29b41f35e3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:25.478311 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8a53aae6-90cb-45bf-b391-b29b41f35e3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:25.478740 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8a53aae6-90cb-45bf-b391-b29b41f35e3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:25.610851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8a53aae6-90cb-45bf-b391-b29b41f35e3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:25.618015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8a53aae6-90cb-45bf-b391-b29b41f35e3f tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1509 microversion: 2.1 time: 0.151333 Jan 11 14:15:25.618575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 212/458] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:25 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:25.638768 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1f40ee73-37cd-4812-a160-eed6c80d4f60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:25.639684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1f40ee73-37cd-4812-a160-eed6c80d4f60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:25.645132 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1f40ee73-37cd-4812-a160-eed6c80d4f60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:25.645570 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1f40ee73-37cd-4812-a160-eed6c80d4f60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:25.646335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1f40ee73-37cd-4812-a160-eed6c80d4f60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:25.646762 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1f40ee73-37cd-4812-a160-eed6c80d4f60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:26.486693 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b5251cb4-4226-44a4-ac91-5acaf5fcff95 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 1.739401 Jan 11 14:15:26.490493 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 247/459] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:24 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:26.492148 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-40ac2b60-868e-479f-84db-15a63ae21977 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:26.492843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-40ac2b60-868e-479f-84db-15a63ae21977 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:26.500169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-40ac2b60-868e-479f-84db-15a63ae21977 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:26.500619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-40ac2b60-868e-479f-84db-15a63ae21977 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:26.501397 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-40ac2b60-868e-479f-84db-15a63ae21977 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:26.501833 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-40ac2b60-868e-479f-84db-15a63ae21977 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:26.627387 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-40ac2b60-868e-479f-84db-15a63ae21977 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:26.634812 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-40ac2b60-868e-479f-84db-15a63ae21977 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.146322 Jan 11 14:15:26.635365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 248/460] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:26 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:26.639481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-98044c12-fa7a-4c88-8082-b6a466efb0d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:26.640097 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-98044c12-fa7a-4c88-8082-b6a466efb0d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:26.645406 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-98044c12-fa7a-4c88-8082-b6a466efb0d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:26.645855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-98044c12-fa7a-4c88-8082-b6a466efb0d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:26.646632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-98044c12-fa7a-4c88-8082-b6a466efb0d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:26.647067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-98044c12-fa7a-4c88-8082-b6a466efb0d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:26.777988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-98044c12-fa7a-4c88-8082-b6a466efb0d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:26.785541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-98044c12-fa7a-4c88-8082-b6a466efb0d5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1509 microversion: 2.1 time: 0.148908 Jan 11 14:15:26.786109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 249/461] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:26 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:27.498535 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6b833b1a-429f-4050-87b2-7c3da79a5c20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:27.499439 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6b833b1a-429f-4050-87b2-7c3da79a5c20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:27.505670 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b833b1a-429f-4050-87b2-7c3da79a5c20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:27.506112 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b833b1a-429f-4050-87b2-7c3da79a5c20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:27.506910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b833b1a-429f-4050-87b2-7c3da79a5c20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:27.507341 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b833b1a-429f-4050-87b2-7c3da79a5c20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:29.133203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1f40ee73-37cd-4812-a160-eed6c80d4f60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 3.497605 Jan 11 14:15:29.134428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 213/462] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:25 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 3500 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:29.141541 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e88040dd-be9f-44cc-a9ad-bf9064f2be9e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:29.142242 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e88040dd-be9f-44cc-a9ad-bf9064f2be9e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:29.148874 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e88040dd-be9f-44cc-a9ad-bf9064f2be9e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:29.149331 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e88040dd-be9f-44cc-a9ad-bf9064f2be9e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:29.150121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e88040dd-be9f-44cc-a9ad-bf9064f2be9e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:29.150562 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e88040dd-be9f-44cc-a9ad-bf9064f2be9e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:29.249785 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6b833b1a-429f-4050-87b2-7c3da79a5c20 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 1.755294 Jan 11 14:15:29.250436 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 250/463] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:27 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:29.255189 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-20568176-d6ed-4cc4-a8e7-c2e2da2d4b97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:29.255897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-20568176-d6ed-4cc4-a8e7-c2e2da2d4b97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:29.262654 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20568176-d6ed-4cc4-a8e7-c2e2da2d4b97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:29.263109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20568176-d6ed-4cc4-a8e7-c2e2da2d4b97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:29.263933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20568176-d6ed-4cc4-a8e7-c2e2da2d4b97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:29.264373 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20568176-d6ed-4cc4-a8e7-c2e2da2d4b97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:29.282367 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e88040dd-be9f-44cc-a9ad-bf9064f2be9e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:29.290126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e88040dd-be9f-44cc-a9ad-bf9064f2be9e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.154574 Jan 11 14:15:29.290696 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 214/464] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:29 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:29.389982 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-20568176-d6ed-4cc4-a8e7-c2e2da2d4b97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:29.397323 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-20568176-d6ed-4cc4-a8e7-c2e2da2d4b97 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1509 microversion: 2.1 time: 0.145801 Jan 11 14:15:29.397882 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 251/465] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:29 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:30.145641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b3b2a978-6df6-4283-a5a9-80ce5a72bae3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:30.146561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b3b2a978-6df6-4283-a5a9-80ce5a72bae3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:30.152845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b3b2a978-6df6-4283-a5a9-80ce5a72bae3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:30.153296 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b3b2a978-6df6-4283-a5a9-80ce5a72bae3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:30.154078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b3b2a978-6df6-4283-a5a9-80ce5a72bae3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:30.154515 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b3b2a978-6df6-4283-a5a9-80ce5a72bae3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:30.260838 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c6563a1d-b41a-435f-927a-1edcafbc2e96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:30.262293 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c6563a1d-b41a-435f-927a-1edcafbc2e96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:30.268462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c6563a1d-b41a-435f-927a-1edcafbc2e96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:30.268913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c6563a1d-b41a-435f-927a-1edcafbc2e96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:30.269690 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c6563a1d-b41a-435f-927a-1edcafbc2e96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:30.270132 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c6563a1d-b41a-435f-927a-1edcafbc2e96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:30.291672 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b3b2a978-6df6-4283-a5a9-80ce5a72bae3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.149492 Jan 11 14:15:30.295645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 215/466] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:30 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:30.307641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ed75731b-5f97-4437-ad81-07dfd54006b1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:30.308829 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ed75731b-5f97-4437-ad81-07dfd54006b1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:30.315572 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ed75731b-5f97-4437-ad81-07dfd54006b1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:30.316019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ed75731b-5f97-4437-ad81-07dfd54006b1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:30.316793 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ed75731b-5f97-4437-ad81-07dfd54006b1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:30.317220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ed75731b-5f97-4437-ad81-07dfd54006b1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:30.415184 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c6563a1d-b41a-435f-927a-1edcafbc2e96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.157856 Jan 11 14:15:30.421985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 252/467] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:30 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:30.427759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a3426125-f6ca-477d-9808-879830a6f8fb tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:30.428550 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a3426125-f6ca-477d-9808-879830a6f8fb tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:30.443621 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3426125-f6ca-477d-9808-879830a6f8fb tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:30.444321 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3426125-f6ca-477d-9808-879830a6f8fb tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:30.445783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3426125-f6ca-477d-9808-879830a6f8fb tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:30.446432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3426125-f6ca-477d-9808-879830a6f8fb tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:30.479323 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ed75731b-5f97-4437-ad81-07dfd54006b1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:30.490040 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ed75731b-5f97-4437-ad81-07dfd54006b1 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.186113 Jan 11 14:15:30.491470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 216/468] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:30 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:30.587897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a3426125-f6ca-477d-9808-879830a6f8fb tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:30.595129 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a3426125-f6ca-477d-9808-879830a6f8fb tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1515 microversion: 2.1 time: 0.171715 Jan 11 14:15:30.595727 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 253/469] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:30 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:31.304323 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5fd47692-95c4-4038-8d04-f19677b6a15a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:31.305392 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5fd47692-95c4-4038-8d04-f19677b6a15a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:31.316239 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5fd47692-95c4-4038-8d04-f19677b6a15a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:31.321430 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5fd47692-95c4-4038-8d04-f19677b6a15a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:31.322504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5fd47692-95c4-4038-8d04-f19677b6a15a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:31.324039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5fd47692-95c4-4038-8d04-f19677b6a15a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:31.414301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5fd47692-95c4-4038-8d04-f19677b6a15a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.114994 Jan 11 14:15:31.419043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 217/470] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:31 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:31.429276 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-15ca286d-15b5-462e-956a-f819fcbefc9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:31.430858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-15ca286d-15b5-462e-956a-f819fcbefc9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:31.438867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-15ca286d-15b5-462e-956a-f819fcbefc9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:31.439511 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-15ca286d-15b5-462e-956a-f819fcbefc9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:31.440468 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-15ca286d-15b5-462e-956a-f819fcbefc9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:31.441037 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-15ca286d-15b5-462e-956a-f819fcbefc9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:31.507935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-44ce9dc0-6e5f-4ced-b8c6-ad4a43bed7c4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:31.508948 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-44ce9dc0-6e5f-4ced-b8c6-ad4a43bed7c4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:31.520519 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44ce9dc0-6e5f-4ced-b8c6-ad4a43bed7c4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:31.521021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44ce9dc0-6e5f-4ced-b8c6-ad4a43bed7c4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:31.521849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44ce9dc0-6e5f-4ced-b8c6-ad4a43bed7c4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:31.522290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-44ce9dc0-6e5f-4ced-b8c6-ad4a43bed7c4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:31.537036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-15ca286d-15b5-462e-956a-f819fcbefc9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.110974 Jan 11 14:15:31.538161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 254/471] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:31 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:31.755911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-44ce9dc0-6e5f-4ced-b8c6-ad4a43bed7c4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:31.766680 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-44ce9dc0-6e5f-4ced-b8c6-ad4a43bed7c4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.262676 Jan 11 14:15:31.772448 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 218/472] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:31 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:31.942476 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3cc90e0f-ba67-4a05-acdd-755efd1ae18e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:31.943269 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3cc90e0f-ba67-4a05-acdd-755efd1ae18e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:31.951782 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3cc90e0f-ba67-4a05-acdd-755efd1ae18e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:31.952232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3cc90e0f-ba67-4a05-acdd-755efd1ae18e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:31.953089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3cc90e0f-ba67-4a05-acdd-755efd1ae18e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:31.953751 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3cc90e0f-ba67-4a05-acdd-755efd1ae18e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:32.105450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3cc90e0f-ba67-4a05-acdd-755efd1ae18e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:32.116337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3cc90e0f-ba67-4a05-acdd-755efd1ae18e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1515 microversion: 2.1 time: 0.178167 Jan 11 14:15:32.118262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 255/473] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:31 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:32.134805 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-825bbf24-b69c-4f0e-b639-91f4e08f05f4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63529041-3e64-4ec5-8483-93d9be732945"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:32.138985 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-825bbf24-b69c-4f0e-b639-91f4e08f05f4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:32.145694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-825bbf24-b69c-4f0e-b639-91f4e08f05f4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:32.146356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-825bbf24-b69c-4f0e-b639-91f4e08f05f4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:32.147339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-825bbf24-b69c-4f0e-b639-91f4e08f05f4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:32.147969 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-825bbf24-b69c-4f0e-b639-91f4e08f05f4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:32.427996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3396045f-7182-4015-8fec-6bfb8a44210a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:32.429391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3396045f-7182-4015-8fec-6bfb8a44210a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:32.439982 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3396045f-7182-4015-8fec-6bfb8a44210a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:32.440737 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3396045f-7182-4015-8fec-6bfb8a44210a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:32.441595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3396045f-7182-4015-8fec-6bfb8a44210a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:32.442031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3396045f-7182-4015-8fec-6bfb8a44210a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:32.448529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-825bbf24-b69c-4f0e-b639-91f4e08f05f4 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317051 Jan 11 14:15:32.452808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 219/474] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:15:32 2022] POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:32.549824 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b299ed89-a947-4373-a70d-5755dbd3ab17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:32.551034 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b299ed89-a947-4373-a70d-5755dbd3ab17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:32.558906 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b299ed89-a947-4373-a70d-5755dbd3ab17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:32.559355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b299ed89-a947-4373-a70d-5755dbd3ab17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:32.560339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b299ed89-a947-4373-a70d-5755dbd3ab17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:32.560940 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b299ed89-a947-4373-a70d-5755dbd3ab17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:37.945540 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b299ed89-a947-4373-a70d-5755dbd3ab17 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 5.400136 Jan 11 14:15:37.946275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 220/475] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:32 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 5402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:37.951970 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6e7824a3-9c91-48e3-bbdc-3eaf9f86bda7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:37.952668 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6e7824a3-9c91-48e3-bbdc-3eaf9f86bda7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:37.960130 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6e7824a3-9c91-48e3-bbdc-3eaf9f86bda7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:37.960581 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6e7824a3-9c91-48e3-bbdc-3eaf9f86bda7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:37.961361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6e7824a3-9c91-48e3-bbdc-3eaf9f86bda7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:37.961799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6e7824a3-9c91-48e3-bbdc-3eaf9f86bda7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:38.030843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3396045f-7182-4015-8fec-6bfb8a44210a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 5.607347 Jan 11 14:15:38.032055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 256/476] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:32 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 5610 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:38.057934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-affc2f91-256f-4e48-b329-8672213c014f req-f48f3951-890f-4134-83c1-f20c6855cd97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57149afd-9a49-4af4-8197-c218a8c0846c", "name": "network-vif-plugged", "status": "completed", "tag": "16deb647-6c63-414a-a191-4b93e1d0501e"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:38.067928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:15:38.067928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:15:38.094525 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-affc2f91-256f-4e48-b329-8672213c014f req-f48f3951-890f-4134-83c1-f20c6855cd97 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:38.095423 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-affc2f91-256f-4e48-b329-8672213c014f req-f48f3951-890f-4134-83c1-f20c6855cd97 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:38.116967 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6e7824a3-9c91-48e3-bbdc-3eaf9f86bda7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:38.129214 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-affc2f91-256f-4e48-b329-8672213c014f req-f48f3951-890f-4134-83c1-f20c6855cd97 service nova] Creating event network-vif-plugged:16deb647-6c63-414a-a191-4b93e1d0501e for instance 57149afd-9a49-4af4-8197-c218a8c0846c on hv-cinder-82413 Jan 11 14:15:38.140521 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6e7824a3-9c91-48e3-bbdc-3eaf9f86bda7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.192952 Jan 11 14:15:38.144450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-affc2f91-256f-4e48-b329-8672213c014f req-f48f3951-890f-4134-83c1-f20c6855cd97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109777 Jan 11 14:15:38.145511 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 257/477] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:38.152533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 221/478] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:37 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:38.959756 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a87b2b37-7f9f-4614-8ba4-7810a5251e66 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:38.961575 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a87b2b37-7f9f-4614-8ba4-7810a5251e66 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:38.968845 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a87b2b37-7f9f-4614-8ba4-7810a5251e66 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:38.969376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a87b2b37-7f9f-4614-8ba4-7810a5251e66 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:38.970270 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a87b2b37-7f9f-4614-8ba4-7810a5251e66 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:38.970790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a87b2b37-7f9f-4614-8ba4-7810a5251e66 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:39.044015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e8bad5e4-333f-479a-b2dd-7847d6939761 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:39.045725 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e8bad5e4-333f-479a-b2dd-7847d6939761 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:39.047589 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a87b2b37-7f9f-4614-8ba4-7810a5251e66 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.092823 Jan 11 14:15:39.048843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 258/479] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:38 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:39.052779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e8bad5e4-333f-479a-b2dd-7847d6939761 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:39.053364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e8bad5e4-333f-479a-b2dd-7847d6939761 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:39.055693 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e8bad5e4-333f-479a-b2dd-7847d6939761 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:39.057209 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e8bad5e4-333f-479a-b2dd-7847d6939761 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:39.148286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e8bad5e4-333f-479a-b2dd-7847d6939761 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.108555 Jan 11 14:15:39.149479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 222/480] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:39 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:39.159892 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-695787a7-3a80-425e-bc3e-915722f65d7b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:39.160801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-695787a7-3a80-425e-bc3e-915722f65d7b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:39.168324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-695787a7-3a80-425e-bc3e-915722f65d7b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:39.169002 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-695787a7-3a80-425e-bc3e-915722f65d7b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:39.169812 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-695787a7-3a80-425e-bc3e-915722f65d7b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:39.170232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-695787a7-3a80-425e-bc3e-915722f65d7b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:39.338054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-695787a7-3a80-425e-bc3e-915722f65d7b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:39.349930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-695787a7-3a80-425e-bc3e-915722f65d7b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.193743 Jan 11 14:15:39.350662 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 259/481] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:39 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:40.060275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-383475c2-36f5-42f5-90f7-883cec6ab4be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:40.061207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-383475c2-36f5-42f5-90f7-883cec6ab4be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:40.068350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-383475c2-36f5-42f5-90f7-883cec6ab4be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:40.068792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-383475c2-36f5-42f5-90f7-883cec6ab4be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:40.069585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-383475c2-36f5-42f5-90f7-883cec6ab4be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:40.070023 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-383475c2-36f5-42f5-90f7-883cec6ab4be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:40.161949 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d13f5efa-7111-4270-b6fe-75411201a030 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:40.162850 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d13f5efa-7111-4270-b6fe-75411201a030 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:40.169907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d13f5efa-7111-4270-b6fe-75411201a030 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:40.170350 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d13f5efa-7111-4270-b6fe-75411201a030 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:40.171125 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d13f5efa-7111-4270-b6fe-75411201a030 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:40.171578 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d13f5efa-7111-4270-b6fe-75411201a030 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:44.203278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-383475c2-36f5-42f5-90f7-883cec6ab4be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 4.146965 Jan 11 14:15:44.203956 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 223/482] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:40 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 4149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:44.208707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-95c2b7a9-178c-4723-b3fd-3082be734f0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:44.209394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-95c2b7a9-178c-4723-b3fd-3082be734f0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:44.216252 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d13f5efa-7111-4270-b6fe-75411201a030 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 4.057781 Jan 11 14:15:44.218034 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95c2b7a9-178c-4723-b3fd-3082be734f0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:44.221293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95c2b7a9-178c-4723-b3fd-3082be734f0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:44.221293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95c2b7a9-178c-4723-b3fd-3082be734f0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:44.221293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95c2b7a9-178c-4723-b3fd-3082be734f0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:44.222295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 260/483] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:40 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 4065 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:44.371879 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-95c2b7a9-178c-4723-b3fd-3082be734f0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:44.380034 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-95c2b7a9-178c-4723-b3fd-3082be734f0c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1317 microversion: 2.1 time: 0.174960 Jan 11 14:15:44.381127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 224/484] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:44 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:45.216588 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8d9c765c-624a-47b3-8fa9-5315eaf1c8b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:45.217704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8d9c765c-624a-47b3-8fa9-5315eaf1c8b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:45.227874 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d9c765c-624a-47b3-8fa9-5315eaf1c8b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.229407 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d9c765c-624a-47b3-8fa9-5315eaf1c8b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.230945 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d9c765c-624a-47b3-8fa9-5315eaf1c8b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.231679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d9c765c-624a-47b3-8fa9-5315eaf1c8b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.234253 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b0bc5992-1738-41b8-ab63-fa1de99c8db7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:45.235387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b0bc5992-1738-41b8-ab63-fa1de99c8db7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:45.243789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b0bc5992-1738-41b8-ab63-fa1de99c8db7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.244499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b0bc5992-1738-41b8-ab63-fa1de99c8db7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.245443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b0bc5992-1738-41b8-ab63-fa1de99c8db7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.246082 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b0bc5992-1738-41b8-ab63-fa1de99c8db7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.350994 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8d9c765c-624a-47b3-8fa9-5315eaf1c8b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.139473 Jan 11 14:15:45.351947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 261/485] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:45 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:45.360080 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b0bc5992-1738-41b8-ab63-fa1de99c8db7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.134271 Jan 11 14:15:45.360470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 225/486] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:45 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:45.397344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cfe354ec-5bdf-41f0-85ea-9f7210b9853f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:45.398043 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cfe354ec-5bdf-41f0-85ea-9f7210b9853f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:45.407616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cfe354ec-5bdf-41f0-85ea-9f7210b9853f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.408073 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cfe354ec-5bdf-41f0-85ea-9f7210b9853f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.408875 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cfe354ec-5bdf-41f0-85ea-9f7210b9853f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.409311 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cfe354ec-5bdf-41f0-85ea-9f7210b9853f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.556355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cfe354ec-5bdf-41f0-85ea-9f7210b9853f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:45.564315 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cfe354ec-5bdf-41f0-85ea-9f7210b9853f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1507 microversion: 2.1 time: 0.170906 Jan 11 14:15:45.564891 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 262/487] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:45 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:45.582305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21c22162-d955-445b-80e5-83d3c59edf77"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:45.583978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:45.593091 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.593862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.595480 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.597504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.717068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] HTTP exception thrown: Invalid volume: volume 21c22162-d955-445b-80e5-83d3c59edf77 is already attached to instances: fe790a9d-f25c-4f0c-852d-3155d29520c0 Jan 11 14:15:45.722172 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Returning 400 to user: Invalid volume: volume 21c22162-d955-445b-80e5-83d3c59edf77 is already attached to instances: fe790a9d-f25c-4f0c-852d-3155d29520c0 {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:15:45.723310 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6bbb6402-c16d-4f3c-83b6-5fac44d1b06a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145539 Jan 11 14:15:45.724494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 226/488] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:15:45 2022] POST /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c/os-volume_attachments => generated 174 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:15:45.796463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-dfb2d2c5-4c8f-45cd-b440-df314145bbb6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:45.796956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-dfb2d2c5-4c8f-45cd-b440-df314145bbb6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:45.803474 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dfb2d2c5-4c8f-45cd-b440-df314145bbb6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.803955 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dfb2d2c5-4c8f-45cd-b440-df314145bbb6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.804760 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dfb2d2c5-4c8f-45cd-b440-df314145bbb6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:45.805193 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dfb2d2c5-4c8f-45cd-b440-df314145bbb6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:45.942171 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-dfb2d2c5-4c8f-45cd-b440-df314145bbb6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lazy-loading 'services' on Instance uuid fe790a9d-f25c-4f0c-852d-3155d29520c0 {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:15:46.084538 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-dfb2d2c5-4c8f-45cd-b440-df314145bbb6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments/21c22162-d955-445b-80e5-83d3c59edf77" status: 202 len: 0 microversion: 2.1 time: 0.291813 Jan 11 14:15:46.086246 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 263/489] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:15:45 2022] DELETE /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments/21c22162-d955-445b-80e5-83d3c59edf77 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:46.094974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0d9a6b84-10ca-4ca1-b0d6-f6f6fe6d293b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:46.096854 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0d9a6b84-10ca-4ca1-b0d6-f6f6fe6d293b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:46.112500 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d9a6b84-10ca-4ca1-b0d6-f6f6fe6d293b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:46.113247 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d9a6b84-10ca-4ca1-b0d6-f6f6fe6d293b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:46.115073 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d9a6b84-10ca-4ca1-b0d6-f6f6fe6d293b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:46.115902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d9a6b84-10ca-4ca1-b0d6-f6f6fe6d293b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:46.180393 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0d9a6b84-10ca-4ca1-b0d6-f6f6fe6d293b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090118 Jan 11 14:15:46.182061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 227/490] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:15:46 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:15:46.376316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a93cdf99-aad1-4bb8-924d-71a9a592bd85 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:46.377570 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-730c9bd8-1bb1-4842-bc3f-252dc1e0af5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:46.378590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-730c9bd8-1bb1-4842-bc3f-252dc1e0af5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:46.379390 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a93cdf99-aad1-4bb8-924d-71a9a592bd85 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:46.392469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a93cdf99-aad1-4bb8-924d-71a9a592bd85 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:46.394944 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-730c9bd8-1bb1-4842-bc3f-252dc1e0af5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:46.395847 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a93cdf99-aad1-4bb8-924d-71a9a592bd85 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:46.396501 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-730c9bd8-1bb1-4842-bc3f-252dc1e0af5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:46.397510 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a93cdf99-aad1-4bb8-924d-71a9a592bd85 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:46.398567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-730c9bd8-1bb1-4842-bc3f-252dc1e0af5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:46.399190 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a93cdf99-aad1-4bb8-924d-71a9a592bd85 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:46.399870 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-730c9bd8-1bb1-4842-bc3f-252dc1e0af5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:46.491049 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a93cdf99-aad1-4bb8-924d-71a9a592bd85 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.126271 Jan 11 14:15:46.492168 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 264/491] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:46 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:46.529452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-730c9bd8-1bb1-4842-bc3f-252dc1e0af5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.161485 Jan 11 14:15:46.533681 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 228/492] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:46 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:47.193484 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9ef7444f-c164-45c9-88c2-493ab7568e01 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:47.194476 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9ef7444f-c164-45c9-88c2-493ab7568e01 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:47.201837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9ef7444f-c164-45c9-88c2-493ab7568e01 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:47.202281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9ef7444f-c164-45c9-88c2-493ab7568e01 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:47.203054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9ef7444f-c164-45c9-88c2-493ab7568e01 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:47.203485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9ef7444f-c164-45c9-88c2-493ab7568e01 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:47.233469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9ef7444f-c164-45c9-88c2-493ab7568e01 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Jan 11 14:15:47.234017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 265/493] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:15:47 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:47.502845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2f0b0d23-9aa9-4f96-ac87-c9af9f585f16 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:47.503853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2f0b0d23-9aa9-4f96-ac87-c9af9f585f16 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:47.510546 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2f0b0d23-9aa9-4f96-ac87-c9af9f585f16 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:47.510989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2f0b0d23-9aa9-4f96-ac87-c9af9f585f16 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:47.511796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2f0b0d23-9aa9-4f96-ac87-c9af9f585f16 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:47.512230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2f0b0d23-9aa9-4f96-ac87-c9af9f585f16 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:47.541256 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-85dc897c-d1d9-41c2-a884-22f2c5617930 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:47.542792 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-85dc897c-d1d9-41c2-a884-22f2c5617930 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:47.548956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-85dc897c-d1d9-41c2-a884-22f2c5617930 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:47.549400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-85dc897c-d1d9-41c2-a884-22f2c5617930 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:47.550174 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-85dc897c-d1d9-41c2-a884-22f2c5617930 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:47.550606 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-85dc897c-d1d9-41c2-a884-22f2c5617930 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:51.466456 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2f0b0d23-9aa9-4f96-ac87-c9af9f585f16 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 3.967366 Jan 11 14:15:51.468928 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 229/494] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:47 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 3970 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:51.481252 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0634851e-dd4a-4721-93c3-717ea71f8e2d tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:51.482290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0634851e-dd4a-4721-93c3-717ea71f8e2d tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:51.502175 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0634851e-dd4a-4721-93c3-717ea71f8e2d tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:51.502655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0634851e-dd4a-4721-93c3-717ea71f8e2d tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:51.503484 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0634851e-dd4a-4721-93c3-717ea71f8e2d tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:51.504205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0634851e-dd4a-4721-93c3-717ea71f8e2d tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:51.509775 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-85dc897c-d1d9-41c2-a884-22f2c5617930 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 3.970467 Jan 11 14:15:51.515188 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 266/495] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:47 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 3978 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:51.536388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0634851e-dd4a-4721-93c3-717ea71f8e2d tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059463 Jan 11 14:15:51.537059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 230/496] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:15:51 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:52.497822 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-aa40875d-6ddf-4af9-ba25-497cf44be2d9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:52.499529 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-aa40875d-6ddf-4af9-ba25-497cf44be2d9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:52.514024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aa40875d-6ddf-4af9-ba25-497cf44be2d9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:52.514706 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aa40875d-6ddf-4af9-ba25-497cf44be2d9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:52.515266 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aa40875d-6ddf-4af9-ba25-497cf44be2d9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:52.516089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aa40875d-6ddf-4af9-ba25-497cf44be2d9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:52.527754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5a59fccf-7420-42f6-8f5f-c39636c86404 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:52.529890 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5a59fccf-7420-42f6-8f5f-c39636c86404 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:52.538262 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a59fccf-7420-42f6-8f5f-c39636c86404 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:52.538805 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a59fccf-7420-42f6-8f5f-c39636c86404 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:52.540019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a59fccf-7420-42f6-8f5f-c39636c86404 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:52.540996 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a59fccf-7420-42f6-8f5f-c39636c86404 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:52.640241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-aa40875d-6ddf-4af9-ba25-497cf44be2d9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.163581 Jan 11 14:15:52.640850 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 267/497] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:52 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:52.646745 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-01aa41eb-7b42-4495-80f2-2627b6a2dfde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:52.647989 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-01aa41eb-7b42-4495-80f2-2627b6a2dfde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:52.655556 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-01aa41eb-7b42-4495-80f2-2627b6a2dfde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:52.656007 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-01aa41eb-7b42-4495-80f2-2627b6a2dfde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:52.656979 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-01aa41eb-7b42-4495-80f2-2627b6a2dfde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:52.657564 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-01aa41eb-7b42-4495-80f2-2627b6a2dfde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:52.666075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5a59fccf-7420-42f6-8f5f-c39636c86404 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.142462 Jan 11 14:15:52.670211 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 231/498] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:52 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:52.695511 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-01aa41eb-7b42-4495-80f2-2627b6a2dfde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053267 Jan 11 14:15:52.696114 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 268/499] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:15:52 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:53.583129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6e7bd5f2-9c3a-4749-9db9-03997542ccb1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:53.584158 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6e7bd5f2-9c3a-4749-9db9-03997542ccb1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:53.591478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6e7bd5f2-9c3a-4749-9db9-03997542ccb1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.591961 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6e7bd5f2-9c3a-4749-9db9-03997542ccb1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.592738 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6e7bd5f2-9c3a-4749-9db9-03997542ccb1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.593338 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6e7bd5f2-9c3a-4749-9db9-03997542ccb1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.624078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-6e7bd5f2-9c3a-4749-9db9-03997542ccb1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lazy-loading 'flavor' on Instance uuid efdb5bf8-cc2d-4e01-ad4d-6a9647801384 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:15:53.658644 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9531b6ef-f03e-4677-a8d8-24775c9fb548 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:53.662131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9531b6ef-f03e-4677-a8d8-24775c9fb548 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:53.695820 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9531b6ef-f03e-4677-a8d8-24775c9fb548 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.700018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9531b6ef-f03e-4677-a8d8-24775c9fb548 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.703396 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9531b6ef-f03e-4677-a8d8-24775c9fb548 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.705908 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9531b6ef-f03e-4677-a8d8-24775c9fb548 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.854692 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9531b6ef-f03e-4677-a8d8-24775c9fb548 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.205682 Jan 11 14:15:53.855351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 269/500] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:53 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:53.861326 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4e897fa7-0739-4ed4-9e1b-2630d117a80c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:53.863257 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4e897fa7-0739-4ed4-9e1b-2630d117a80c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:53.871923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4e897fa7-0739-4ed4-9e1b-2630d117a80c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.872632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4e897fa7-0739-4ed4-9e1b-2630d117a80c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.873489 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4e897fa7-0739-4ed4-9e1b-2630d117a80c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.873933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4e897fa7-0739-4ed4-9e1b-2630d117a80c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.934750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6e7bd5f2-9c3a-4749-9db9-03997542ccb1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/action" status: 200 len: 32 microversion: 2.1 time: 0.355403 Jan 11 14:15:53.936286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 232/501] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:53 2022] POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:15:53.953782 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cff1b843-e556-4dca-8c5e-5c47296b9f84 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:53.955687 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cff1b843-e556-4dca-8c5e-5c47296b9f84 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:53.969388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cff1b843-e556-4dca-8c5e-5c47296b9f84 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.970979 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cff1b843-e556-4dca-8c5e-5c47296b9f84 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.972090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cff1b843-e556-4dca-8c5e-5c47296b9f84 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.973645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cff1b843-e556-4dca-8c5e-5c47296b9f84 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.977203 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4e897fa7-0739-4ed4-9e1b-2630d117a80c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.120229 Jan 11 14:15:53.978016 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 270/502] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:53 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:53.984642 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-afb657af-5fb1-4f75-a7a1-801d5a194b0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:53.985731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-afb657af-5fb1-4f75-a7a1-801d5a194b0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:53.993716 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-afb657af-5fb1-4f75-a7a1-801d5a194b0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.994415 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-afb657af-5fb1-4f75-a7a1-801d5a194b0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:53.995408 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-afb657af-5fb1-4f75-a7a1-801d5a194b0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:53.996032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-afb657af-5fb1-4f75-a7a1-801d5a194b0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:54.016297 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cff1b843-e556-4dca-8c5e-5c47296b9f84 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078543 Jan 11 14:15:54.017147 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 233/503] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:15:53 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:54.233614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-afb657af-5fb1-4f75-a7a1-801d5a194b0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:54.248124 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-afb657af-5fb1-4f75-a7a1-801d5a194b0e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.267758 Jan 11 14:15:54.248905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 271/504] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:53 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:54.868363 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-91e50b19-e0a1-4a3a-9b8a-f0dbf56f532e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:54.870361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-91e50b19-e0a1-4a3a-9b8a-f0dbf56f532e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:54.881151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-91e50b19-e0a1-4a3a-9b8a-f0dbf56f532e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:54.881817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-91e50b19-e0a1-4a3a-9b8a-f0dbf56f532e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:54.882612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-91e50b19-e0a1-4a3a-9b8a-f0dbf56f532e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:54.883044 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-91e50b19-e0a1-4a3a-9b8a-f0dbf56f532e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:54.965575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-91e50b19-e0a1-4a3a-9b8a-f0dbf56f532e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.102585 Jan 11 14:15:54.966209 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 234/505] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:54 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:54.991995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4c4de4ca-a697-4ac5-bcbe-5d68c127dd58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:54.993887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4c4de4ca-a697-4ac5-bcbe-5d68c127dd58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:55.000517 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4c4de4ca-a697-4ac5-bcbe-5d68c127dd58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:55.001231 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4c4de4ca-a697-4ac5-bcbe-5d68c127dd58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:55.002240 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4c4de4ca-a697-4ac5-bcbe-5d68c127dd58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:55.003315 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4c4de4ca-a697-4ac5-bcbe-5d68c127dd58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:55.029210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-29ae2d29-a319-4442-9bc9-a388217e75ed tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:55.030548 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-29ae2d29-a319-4442-9bc9-a388217e75ed tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:55.038648 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-29ae2d29-a319-4442-9bc9-a388217e75ed tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:55.039488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-29ae2d29-a319-4442-9bc9-a388217e75ed tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:55.040720 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-29ae2d29-a319-4442-9bc9-a388217e75ed tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:55.041403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-29ae2d29-a319-4442-9bc9-a388217e75ed tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:55.082863 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-29ae2d29-a319-4442-9bc9-a388217e75ed tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058320 Jan 11 14:15:55.089062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 235/506] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:15:55 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:15:55.099742 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4c4de4ca-a697-4ac5-bcbe-5d68c127dd58 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.112875 Jan 11 14:15:55.104318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 272/507] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:54 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:55.269751 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c38ee68e-10da-4b79-bdaa-aa3fdde08dd3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:55.269751 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c38ee68e-10da-4b79-bdaa-aa3fdde08dd3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:55.280786 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1116923119", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "60123190-3a8f-4b75-b7ad-1e70cf2044c8"}]}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:55.282474 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c38ee68e-10da-4b79-bdaa-aa3fdde08dd3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:55.282928 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c38ee68e-10da-4b79-bdaa-aa3fdde08dd3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:55.283755 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c38ee68e-10da-4b79-bdaa-aa3fdde08dd3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:55.284192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c38ee68e-10da-4b79-bdaa-aa3fdde08dd3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:55.363229 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] validate_networks() for [('60123190-3a8f-4b75-b7ad-1e70cf2044c8', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:15:55.572207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c38ee68e-10da-4b79-bdaa-aa3fdde08dd3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:55.591452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c38ee68e-10da-4b79-bdaa-aa3fdde08dd3 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.327602 Jan 11 14:15:55.594903 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 236/508] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:55 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:55.978817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-373daf12-6a59-4a74-9c0a-3a470ab13807 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:55.982119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-373daf12-6a59-4a74-9c0a-3a470ab13807 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:55.989734 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-373daf12-6a59-4a74-9c0a-3a470ab13807 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:55.992365 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-373daf12-6a59-4a74-9c0a-3a470ab13807 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:55.993374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-373daf12-6a59-4a74-9c0a-3a470ab13807 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:55.993905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-373daf12-6a59-4a74-9c0a-3a470ab13807 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.068372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-373daf12-6a59-4a74-9c0a-3a470ab13807 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.092426 Jan 11 14:15:56.070296 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 237/509] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:55 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:56.086993 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1daeb05f-9753-4b24-91c9-fe2c4ef6c862 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:56.087863 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1daeb05f-9753-4b24-91c9-fe2c4ef6c862 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:56.097236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1daeb05f-9753-4b24-91c9-fe2c4ef6c862 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:56.097927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1daeb05f-9753-4b24-91c9-fe2c4ef6c862 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.099227 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1daeb05f-9753-4b24-91c9-fe2c4ef6c862 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:56.099953 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1daeb05f-9753-4b24-91c9-fe2c4ef6c862 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.181095 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:15:56.182225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:15:56.183422 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:15:56.184218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:15:56.184798 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:15:56.199131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:56.199600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.200400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:56.204678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.233333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Getting quotas for project b02bf5f593a54c658a76fff0246febf4. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:15:56.237887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Getting quotas for user 23f705ed82e441229edd5a48b3797b32 and project b02bf5f593a54c658a76fff0246febf4. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:15:56.252611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:15:56.255324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:15:56.303414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-1daeb05f-9753-4b24-91c9-fe2c4ef6c862 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lazy-loading 'services' on Instance uuid 3f529c1c-6a41-4af2-9b68-66480142d541 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:15:56.345672 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-370cc351-78ed-439f-8f75-f586ef167d3f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070430 Jan 11 14:15:56.346888 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 273/510] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:15:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 14:15:56.351683 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5967c685-e2d1-4225-8874-a6151aaea66f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:56.352906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5967c685-e2d1-4225-8874-a6151aaea66f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:56.370391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5967c685-e2d1-4225-8874-a6151aaea66f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:56.371105 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5967c685-e2d1-4225-8874-a6151aaea66f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.372074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5967c685-e2d1-4225-8874-a6151aaea66f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:56.372662 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5967c685-e2d1-4225-8874-a6151aaea66f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.481097 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5967c685-e2d1-4225-8874-a6151aaea66f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.132707 Jan 11 14:15:56.482548 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 274/511] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:56 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:56.491364 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1a81c38f-6cbe-4f10-9620-20595391d9b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:56.492341 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1a81c38f-6cbe-4f10-9620-20595391d9b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:56.532878 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1daeb05f-9753-4b24-91c9-fe2c4ef6c862 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541/os-volume_attachments/93eb2567-048f-4a7a-990e-d855804defe5" status: 202 len: 0 microversion: 2.1 time: 0.459852 Jan 11 14:15:56.533754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 238/512] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:15:56 2022] DELETE /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541/os-volume_attachments/93eb2567-048f-4a7a-990e-d855804defe5 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:56.593551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1a81c38f-6cbe-4f10-9620-20595391d9b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:56.602971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1a81c38f-6cbe-4f10-9620-20595391d9b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1218 microversion: 2.1 time: 0.117853 Jan 11 14:15:56.606511 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 275/513] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:56 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:56.631024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-328c428d-f576-4654-8969-360443e26314 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:56.632502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-328c428d-f576-4654-8969-360443e26314 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:56.649920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-328c428d-f576-4654-8969-360443e26314 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:56.651701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-328c428d-f576-4654-8969-360443e26314 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.654882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-328c428d-f576-4654-8969-360443e26314 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:56.656148 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-328c428d-f576-4654-8969-360443e26314 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:56.926656 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-328c428d-f576-4654-8969-360443e26314 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:56.937360 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-328c428d-f576-4654-8969-360443e26314 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.329058 Jan 11 14:15:56.946732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 239/514] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:56 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:57.083549 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a8fe127a-462d-41b4-b077-21fa59bd2866 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:57.084505 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a8fe127a-462d-41b4-b077-21fa59bd2866 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:57.092058 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8fe127a-462d-41b4-b077-21fa59bd2866 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:57.092793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8fe127a-462d-41b4-b077-21fa59bd2866 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:57.094089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8fe127a-462d-41b4-b077-21fa59bd2866 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:57.094551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a8fe127a-462d-41b4-b077-21fa59bd2866 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:57.231292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a8fe127a-462d-41b4-b077-21fa59bd2866 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.151917 Jan 11 14:15:57.234165 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 276/515] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:57 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:57.495315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-86c7b51c-27b7-4df1-b1d0-58a9ee8b748b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:57.496465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-86c7b51c-27b7-4df1-b1d0-58a9ee8b748b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:57.503914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-86c7b51c-27b7-4df1-b1d0-58a9ee8b748b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:57.504564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-86c7b51c-27b7-4df1-b1d0-58a9ee8b748b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:57.505516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-86c7b51c-27b7-4df1-b1d0-58a9ee8b748b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:57.506227 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-86c7b51c-27b7-4df1-b1d0-58a9ee8b748b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:57.596238 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-86c7b51c-27b7-4df1-b1d0-58a9ee8b748b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.104407 Jan 11 14:15:57.600134 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 240/516] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:57 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:15:57.622685 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-95ff6e62-0c81-4ea2-acdb-ff86ddb70511 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:57.623413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-95ff6e62-0c81-4ea2-acdb-ff86ddb70511 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:57.630408 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-95ff6e62-0c81-4ea2-acdb-ff86ddb70511 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:57.630853 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-95ff6e62-0c81-4ea2-acdb-ff86ddb70511 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:57.631676 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-95ff6e62-0c81-4ea2-acdb-ff86ddb70511 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:57.632110 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-95ff6e62-0c81-4ea2-acdb-ff86ddb70511 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:57.705914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-95ff6e62-0c81-4ea2-acdb-ff86ddb70511 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:57.716377 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-95ff6e62-0c81-4ea2-acdb-ff86ddb70511 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1270 microversion: 2.1 time: 0.097896 Jan 11 14:15:57.717210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 277/517] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:57 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:15:57.954646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f5392e5f-6ae5-42e9-a880-7c0352435507 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:57.955341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f5392e5f-6ae5-42e9-a880-7c0352435507 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:57.963117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f5392e5f-6ae5-42e9-a880-7c0352435507 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:57.964104 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f5392e5f-6ae5-42e9-a880-7c0352435507 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:57.965092 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f5392e5f-6ae5-42e9-a880-7c0352435507 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:57.965530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f5392e5f-6ae5-42e9-a880-7c0352435507 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.159189 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f5392e5f-6ae5-42e9-a880-7c0352435507 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:58.168629 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f5392e5f-6ae5-42e9-a880-7c0352435507 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.218005 Jan 11 14:15:58.169302 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 241/518] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:57 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:58.244935 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bf6ec07b-aa4a-4347-b074-94eb73ac60f5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:58.246082 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bf6ec07b-aa4a-4347-b074-94eb73ac60f5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:58.253279 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bf6ec07b-aa4a-4347-b074-94eb73ac60f5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:58.254761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bf6ec07b-aa4a-4347-b074-94eb73ac60f5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.255713 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bf6ec07b-aa4a-4347-b074-94eb73ac60f5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:58.256173 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bf6ec07b-aa4a-4347-b074-94eb73ac60f5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.325864 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bf6ec07b-aa4a-4347-b074-94eb73ac60f5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.084687 Jan 11 14:15:58.326548 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 278/519] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:58 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:15:58.609468 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-77f017aa-cd4f-475e-a1c5-924369f04def tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:58.610920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-77f017aa-cd4f-475e-a1c5-924369f04def tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:58.618691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77f017aa-cd4f-475e-a1c5-924369f04def tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:58.619470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77f017aa-cd4f-475e-a1c5-924369f04def tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.621420 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77f017aa-cd4f-475e-a1c5-924369f04def tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:58.622195 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77f017aa-cd4f-475e-a1c5-924369f04def tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.718563 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-77f017aa-cd4f-475e-a1c5-924369f04def tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.114710 Jan 11 14:15:58.719643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 242/520] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:58 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:15:58.734804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-68e7d30f-1235-4229-9921-51ac80961642 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:58.736463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-68e7d30f-1235-4229-9921-51ac80961642 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:58.758676 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68e7d30f-1235-4229-9921-51ac80961642 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:58.759513 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68e7d30f-1235-4229-9921-51ac80961642 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.761428 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68e7d30f-1235-4229-9921-51ac80961642 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:58.762181 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-68e7d30f-1235-4229-9921-51ac80961642 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.841757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7d410c78-f5e7-4735-95e8-b6384fdacc30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:58.842991 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7d410c78-f5e7-4735-95e8-b6384fdacc30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:58.852087 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7d410c78-f5e7-4735-95e8-b6384fdacc30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:58.853605 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7d410c78-f5e7-4735-95e8-b6384fdacc30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.854697 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7d410c78-f5e7-4735-95e8-b6384fdacc30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:58.855355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7d410c78-f5e7-4735-95e8-b6384fdacc30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:58.890912 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7d410c78-f5e7-4735-95e8-b6384fdacc30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Going to try to terminate instance {{(pid=116475) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:15:58.996867 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7d410c78-f5e7-4735-95e8-b6384fdacc30 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 204 len: 0 microversion: 2.1 time: 0.158311 Jan 11 14:15:59.001710 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 243/521] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:15:58 2022] DELETE /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 14:15:59.008032 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-deca4a06-d0f5-4f1c-b99c-ebd7bbe9f372 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:59.009205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-deca4a06-d0f5-4f1c-b99c-ebd7bbe9f372 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:59.017077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-deca4a06-d0f5-4f1c-b99c-ebd7bbe9f372 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.017600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-deca4a06-d0f5-4f1c-b99c-ebd7bbe9f372 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.018848 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-deca4a06-d0f5-4f1c-b99c-ebd7bbe9f372 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.019383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-deca4a06-d0f5-4f1c-b99c-ebd7bbe9f372 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.060705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-68e7d30f-1235-4229-9921-51ac80961642 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:59.068254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-68e7d30f-1235-4229-9921-51ac80961642 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.338701 Jan 11 14:15:59.068829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 279/522] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:58 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:59.185294 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-aafd01cf-c499-4ce9-8ff5-0b26dcdcdb98 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:15:59.185886 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-aafd01cf-c499-4ce9-8ff5-0b26dcdcdb98 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:59.192215 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aafd01cf-c499-4ce9-8ff5-0b26dcdcdb98 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.192876 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aafd01cf-c499-4ce9-8ff5-0b26dcdcdb98 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.193660 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aafd01cf-c499-4ce9-8ff5-0b26dcdcdb98 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.194202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aafd01cf-c499-4ce9-8ff5-0b26dcdcdb98 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.253311 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-deca4a06-d0f5-4f1c-b99c-ebd7bbe9f372 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:59.261787 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-deca4a06-d0f5-4f1c-b99c-ebd7bbe9f372 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1515 microversion: 2.1 time: 0.258742 Jan 11 14:15:59.262532 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 244/523] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:59 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1515 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:59.337759 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4082e081-069a-499a-bb05-d359d0f4e6ff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:59.339436 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4082e081-069a-499a-bb05-d359d0f4e6ff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:59.351431 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4082e081-069a-499a-bb05-d359d0f4e6ff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.351927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4082e081-069a-499a-bb05-d359d0f4e6ff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.352723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4082e081-069a-499a-bb05-d359d0f4e6ff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.353162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4082e081-069a-499a-bb05-d359d0f4e6ff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.438899 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4082e081-069a-499a-bb05-d359d0f4e6ff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.104761 Jan 11 14:15:59.441315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 245/524] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:15:59 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:15:59.442630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-aafd01cf-c499-4ce9-8ff5-0b26dcdcdb98 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:15:59.451174 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-aafd01cf-c499-4ce9-8ff5-0b26dcdcdb98 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.269568 Jan 11 14:15:59.451761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 280/525] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:15:59 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:15:59.552272 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-a55b09ea-216d-42cf-8e39-a546417d9070 req-35c2bcf8-9b11-4a7d-839f-943c6a7cb65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72dedc58-795a-45be-946e-b22d685ee6c1", "tag": "097e8414-4883-4986-ba49-5f760c6cbef9"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:59.554436 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:15:59.554436 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:15:59.563161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-a55b09ea-216d-42cf-8e39-a546417d9070 req-35c2bcf8-9b11-4a7d-839f-943c6a7cb65f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.563632 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-a55b09ea-216d-42cf-8e39-a546417d9070 req-35c2bcf8-9b11-4a7d-839f-943c6a7cb65f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.576883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-a55b09ea-216d-42cf-8e39-a546417d9070 req-35c2bcf8-9b11-4a7d-839f-943c6a7cb65f service nova] Creating event network-changed:097e8414-4883-4986-ba49-5f760c6cbef9 for instance 72dedc58-795a-45be-946e-b22d685ee6c1 on hv-cinder-82413 Jan 11 14:15:59.586703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-a55b09ea-216d-42cf-8e39-a546417d9070 req-35c2bcf8-9b11-4a7d-839f-943c6a7cb65f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038782 Jan 11 14:15:59.587532 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 246/526] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:15:59.732433 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b567cc01-50a2-4c64-aec4-102eb6e03de4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:15:59.733413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b567cc01-50a2-4c64-aec4-102eb6e03de4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:15:59.739355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b567cc01-50a2-4c64-aec4-102eb6e03de4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.739926 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b567cc01-50a2-4c64-aec4-102eb6e03de4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.740765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b567cc01-50a2-4c64-aec4-102eb6e03de4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:15:59.741261 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b567cc01-50a2-4c64-aec4-102eb6e03de4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:15:59.820404 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b567cc01-50a2-4c64-aec4-102eb6e03de4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.091962 Jan 11 14:15:59.821167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 281/527] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:15:59 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:00.086928 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b55983c3-4cf1-464a-8992-5746b96604a0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:00.088358 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b55983c3-4cf1-464a-8992-5746b96604a0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:00.094755 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b55983c3-4cf1-464a-8992-5746b96604a0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.095587 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b55983c3-4cf1-464a-8992-5746b96604a0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.096470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b55983c3-4cf1-464a-8992-5746b96604a0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.096997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b55983c3-4cf1-464a-8992-5746b96604a0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.281152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3e6975c8-106f-40c5-b39f-fa2b6a70f1b9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:00.282180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3e6975c8-106f-40c5-b39f-fa2b6a70f1b9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:00.290611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3e6975c8-106f-40c5-b39f-fa2b6a70f1b9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.291349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3e6975c8-106f-40c5-b39f-fa2b6a70f1b9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.292376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3e6975c8-106f-40c5-b39f-fa2b6a70f1b9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.293011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3e6975c8-106f-40c5-b39f-fa2b6a70f1b9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.315041 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b55983c3-4cf1-464a-8992-5746b96604a0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:00.328341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b55983c3-4cf1-464a-8992-5746b96604a0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.245620 Jan 11 14:16:00.335390 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 247/528] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:00 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:00.451600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-54a6f11e-6ced-47c2-b73a-93c1c0e8c9e0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:00.452979 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-54a6f11e-6ced-47c2-b73a-93c1c0e8c9e0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:00.458800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54a6f11e-6ced-47c2-b73a-93c1c0e8c9e0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.459365 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54a6f11e-6ced-47c2-b73a-93c1c0e8c9e0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.460285 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54a6f11e-6ced-47c2-b73a-93c1c0e8c9e0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.460823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54a6f11e-6ced-47c2-b73a-93c1c0e8c9e0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.534686 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3e6975c8-106f-40c5-b39f-fa2b6a70f1b9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:00.545034 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3e6975c8-106f-40c5-b39f-fa2b6a70f1b9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1515 microversion: 2.1 time: 0.268477 Jan 11 14:16:00.548043 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 282/529] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:00 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:00.560300 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bdce0f64-35f1-4c5b-8645-604228e08ed9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:00.563131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bdce0f64-35f1-4c5b-8645-604228e08ed9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:00.577016 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdce0f64-35f1-4c5b-8645-604228e08ed9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.578908 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdce0f64-35f1-4c5b-8645-604228e08ed9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.580249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdce0f64-35f1-4c5b-8645-604228e08ed9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.580695 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdce0f64-35f1-4c5b-8645-604228e08ed9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.595356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-54a6f11e-6ced-47c2-b73a-93c1c0e8c9e0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.148734 Jan 11 14:16:00.596461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 248/530] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:00 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:00.753031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-bdce0f64-35f1-4c5b-8645-604228e08ed9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:00.758283 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bdce0f64-35f1-4c5b-8645-604228e08ed9 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.210637 Jan 11 14:16:00.758974 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 283/531] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:00 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:00.833698 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-06492408-4264-4035-89f5-1d157bbc28ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:00.834691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-06492408-4264-4035-89f5-1d157bbc28ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:00.842176 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-06492408-4264-4035-89f5-1d157bbc28ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.842629 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-06492408-4264-4035-89f5-1d157bbc28ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.843411 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-06492408-4264-4035-89f5-1d157bbc28ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:00.843858 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-06492408-4264-4035-89f5-1d157bbc28ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:00.964814 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-06492408-4264-4035-89f5-1d157bbc28ca tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.135361 Jan 11 14:16:00.965625 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 249/532] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:00 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:01.345502 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-852599c1-d47f-486b-a862-67ac9eae778e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:01.346039 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-852599c1-d47f-486b-a862-67ac9eae778e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:01.352297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-852599c1-d47f-486b-a862-67ac9eae778e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.352739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-852599c1-d47f-486b-a862-67ac9eae778e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.353520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-852599c1-d47f-486b-a862-67ac9eae778e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.353951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-852599c1-d47f-486b-a862-67ac9eae778e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.532534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-852599c1-d47f-486b-a862-67ac9eae778e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:01.535456 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-852599c1-d47f-486b-a862-67ac9eae778e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.193468 Jan 11 14:16:01.544782 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 284/533] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:01 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:01.562354 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-74ffca8b-249b-4c04-93ee-e0fdb8c60b40 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:01.563100 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-74ffca8b-249b-4c04-93ee-e0fdb8c60b40 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:01.570536 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-74ffca8b-249b-4c04-93ee-e0fdb8c60b40 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.571179 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-74ffca8b-249b-4c04-93ee-e0fdb8c60b40 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.571992 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-74ffca8b-249b-4c04-93ee-e0fdb8c60b40 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.572429 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-74ffca8b-249b-4c04-93ee-e0fdb8c60b40 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.606833 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b2cdb112-8e27-40f0-8746-3f8b7b8b51c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:01.607971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b2cdb112-8e27-40f0-8746-3f8b7b8b51c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:01.613760 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b2cdb112-8e27-40f0-8746-3f8b7b8b51c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.614206 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b2cdb112-8e27-40f0-8746-3f8b7b8b51c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.614988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b2cdb112-8e27-40f0-8746-3f8b7b8b51c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.615413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b2cdb112-8e27-40f0-8746-3f8b7b8b51c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.696319 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b2cdb112-8e27-40f0-8746-3f8b7b8b51c4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.093589 Jan 11 14:16:01.697457 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 285/534] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:01 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:01.775899 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5e26baf7-11f9-476a-bf69-6490c6f3edba tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:01.776697 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5e26baf7-11f9-476a-bf69-6490c6f3edba tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:01.783810 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e26baf7-11f9-476a-bf69-6490c6f3edba tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.784162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e26baf7-11f9-476a-bf69-6490c6f3edba tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.784950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e26baf7-11f9-476a-bf69-6490c6f3edba tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.785795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e26baf7-11f9-476a-bf69-6490c6f3edba tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.803893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-74ffca8b-249b-4c04-93ee-e0fdb8c60b40 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:01.816222 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-74ffca8b-249b-4c04-93ee-e0fdb8c60b40 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1515 microversion: 2.1 time: 0.257663 Jan 11 14:16:01.816988 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 250/535] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:01 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:01.976527 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c9a14e72-1c33-4446-ad59-b65ce81267b7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:01.977700 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c9a14e72-1c33-4446-ad59-b65ce81267b7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:01.985192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c9a14e72-1c33-4446-ad59-b65ce81267b7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.985834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c9a14e72-1c33-4446-ad59-b65ce81267b7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:01.986872 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c9a14e72-1c33-4446-ad59-b65ce81267b7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:01.987322 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c9a14e72-1c33-4446-ad59-b65ce81267b7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.001597 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5e26baf7-11f9-476a-bf69-6490c6f3edba tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:02.015265 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5e26baf7-11f9-476a-bf69-6490c6f3edba tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.243464 Jan 11 14:16:02.016301 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 286/536] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:01 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:02.080083 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c9a14e72-1c33-4446-ad59-b65ce81267b7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.107007 Jan 11 14:16:02.081048 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 251/537] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:01 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:02.164253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-6e80b8cc-d5c9-48c2-bdd5-933ba07a7367 req-6e759273-93dd-4caf-bb90-add36cb6e077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f529c1c-6a41-4af2-9b68-66480142d541", "name": "network-vif-deleted", "tag": "05f5ded1-fa13-416c-a773-af2edc884f66"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:02.166108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:16:02.166108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:16:02.178262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-6e80b8cc-d5c9-48c2-bdd5-933ba07a7367 req-6e759273-93dd-4caf-bb90-add36cb6e077 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:02.178951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-6e80b8cc-d5c9-48c2-bdd5-933ba07a7367 req-6e759273-93dd-4caf-bb90-add36cb6e077 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.191455 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-6e80b8cc-d5c9-48c2-bdd5-933ba07a7367 req-6e759273-93dd-4caf-bb90-add36cb6e077 service nova] Creating event network-vif-deleted:05f5ded1-fa13-416c-a773-af2edc884f66 for instance 3f529c1c-6a41-4af2-9b68-66480142d541 on hv-cinder-82413 Jan 11 14:16:02.197287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-6e80b8cc-d5c9-48c2-bdd5-933ba07a7367 req-6e759273-93dd-4caf-bb90-add36cb6e077 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036515 Jan 11 14:16:02.198113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 287/538] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:16:02.551896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c53cc0b3-8c13-4614-8b83-d24cf2a92e13 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:02.552585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c53cc0b3-8c13-4614-8b83-d24cf2a92e13 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:02.559349 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c53cc0b3-8c13-4614-8b83-d24cf2a92e13 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:02.559815 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c53cc0b3-8c13-4614-8b83-d24cf2a92e13 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.560590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c53cc0b3-8c13-4614-8b83-d24cf2a92e13 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:02.561050 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c53cc0b3-8c13-4614-8b83-d24cf2a92e13 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.699872 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c53cc0b3-8c13-4614-8b83-d24cf2a92e13 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:02.710409 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c53cc0b3-8c13-4614-8b83-d24cf2a92e13 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.162459 Jan 11 14:16:02.710592 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e3d95ab3-9f84-4339-b12d-3ee10fe9d402 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:02.711694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 252/539] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:02 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:02.711817 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e3d95ab3-9f84-4339-b12d-3ee10fe9d402 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:02.725171 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e3d95ab3-9f84-4339-b12d-3ee10fe9d402 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:02.725691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e3d95ab3-9f84-4339-b12d-3ee10fe9d402 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.726471 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e3d95ab3-9f84-4339-b12d-3ee10fe9d402 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:02.726900 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e3d95ab3-9f84-4339-b12d-3ee10fe9d402 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.828132 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e3d95ab3-9f84-4339-b12d-3ee10fe9d402 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.121956 Jan 11 14:16:02.830501 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 288/540] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:02 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:02.834560 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:02.835185 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:02.842190 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:02.842869 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.843840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:02.844320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.877797 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:02.878412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:02.878945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lazy-loading 'fault' on Instance uuid 3f529c1c-6a41-4af2-9b68-66480142d541 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:16:02.925736 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:02.933212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1808996b-6ea1-469c-9e2f-88adef9d6657 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 200 len: 1309 microversion: 2.1 time: 0.103057 Jan 11 14:16:02.934303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 253/541] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:02 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:03.033258 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6ef8ede6-fd90-4199-bf29-ea5941cba00b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:03.034208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6ef8ede6-fd90-4199-bf29-ea5941cba00b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:03.041191 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6ef8ede6-fd90-4199-bf29-ea5941cba00b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.041759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6ef8ede6-fd90-4199-bf29-ea5941cba00b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.042633 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6ef8ede6-fd90-4199-bf29-ea5941cba00b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.043139 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6ef8ede6-fd90-4199-bf29-ea5941cba00b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.091815 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4fefe3e3-dc06-4aeb-8b0c-97d748691311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:03.092784 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4fefe3e3-dc06-4aeb-8b0c-97d748691311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:03.099474 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4fefe3e3-dc06-4aeb-8b0c-97d748691311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.099981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4fefe3e3-dc06-4aeb-8b0c-97d748691311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.100789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4fefe3e3-dc06-4aeb-8b0c-97d748691311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.101231 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4fefe3e3-dc06-4aeb-8b0c-97d748691311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.178179 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4fefe3e3-dc06-4aeb-8b0c-97d748691311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.090597 Jan 11 14:16:03.182723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 254/542] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:03 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:03.469788 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6ef8ede6-fd90-4199-bf29-ea5941cba00b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:03.477584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6ef8ede6-fd90-4199-bf29-ea5941cba00b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.448333 Jan 11 14:16:03.478148 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 289/543] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:03 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:03.730063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8c100a1f-c817-4bfa-bf1b-3fce86aadcb9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:03.730692 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8c100a1f-c817-4bfa-bf1b-3fce86aadcb9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:03.737480 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c100a1f-c817-4bfa-bf1b-3fce86aadcb9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.737926 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c100a1f-c817-4bfa-bf1b-3fce86aadcb9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.738694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c100a1f-c817-4bfa-bf1b-3fce86aadcb9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.739218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c100a1f-c817-4bfa-bf1b-3fce86aadcb9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.839279 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-154cfe79-60b0-49d7-b53f-cf8b4d4b420a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:03.840929 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-154cfe79-60b0-49d7-b53f-cf8b4d4b420a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:03.847909 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-154cfe79-60b0-49d7-b53f-cf8b4d4b420a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.848362 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-154cfe79-60b0-49d7-b53f-cf8b4d4b420a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.849141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-154cfe79-60b0-49d7-b53f-cf8b4d4b420a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.849601 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-154cfe79-60b0-49d7-b53f-cf8b4d4b420a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.882635 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8c100a1f-c817-4bfa-bf1b-3fce86aadcb9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:03.891024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8c100a1f-c817-4bfa-bf1b-3fce86aadcb9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.165417 Jan 11 14:16:03.891638 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 255/544] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:03 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:03.928481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-154cfe79-60b0-49d7-b53f-cf8b4d4b420a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.092814 Jan 11 14:16:03.929130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 290/545] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:03 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:03.950250 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:03.950853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 3f529c1c-6a41-4af2-9b68-66480142d541] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:03.956756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.957275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.958045 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:03.958476 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:03.972291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] HTTP exception thrown: Instance 3f529c1c-6a41-4af2-9b68-66480142d541 could not be found. Jan 11 14:16:03.972912 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Returning 404 to user: Instance 3f529c1c-6a41-4af2-9b68-66480142d541 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:16:03.973736 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-55f181f2-8d21-43e2-935a-f3e8d0521196 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541" status: 404 len: 111 microversion: 2.1 time: 0.027507 Jan 11 14:16:03.974394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 256/546] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:03 2022] GET /compute/v2.1/servers/3f529c1c-6a41-4af2-9b68-66480142d541 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:16:04.191033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6f712740-a112-4e98-98d9-c83b76604e4a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:04.192612 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6f712740-a112-4e98-98d9-c83b76604e4a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:04.200557 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f712740-a112-4e98-98d9-c83b76604e4a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:04.201245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f712740-a112-4e98-98d9-c83b76604e4a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:04.202111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f712740-a112-4e98-98d9-c83b76604e4a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:04.202536 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f712740-a112-4e98-98d9-c83b76604e4a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:04.325638 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6f712740-a112-4e98-98d9-c83b76604e4a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.138899 Jan 11 14:16:04.326413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 291/547] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:04 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:04.493888 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0c751866-f7ee-4cdb-8fbf-766e1c7bd7a6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:04.494577 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0c751866-f7ee-4cdb-8fbf-766e1c7bd7a6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:04.500859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0c751866-f7ee-4cdb-8fbf-766e1c7bd7a6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:04.501310 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0c751866-f7ee-4cdb-8fbf-766e1c7bd7a6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:04.502093 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0c751866-f7ee-4cdb-8fbf-766e1c7bd7a6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:04.502530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0c751866-f7ee-4cdb-8fbf-766e1c7bd7a6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:04.632642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0c751866-f7ee-4cdb-8fbf-766e1c7bd7a6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:04.640899 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0c751866-f7ee-4cdb-8fbf-766e1c7bd7a6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.150701 Jan 11 14:16:04.641449 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 257/548] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:04 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:04.908358 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1cf64cad-2b8d-4fae-9558-4f071e992777 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:04.909172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1cf64cad-2b8d-4fae-9558-4f071e992777 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:04.916448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1cf64cad-2b8d-4fae-9558-4f071e992777 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:04.916929 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1cf64cad-2b8d-4fae-9558-4f071e992777 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:04.917718 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1cf64cad-2b8d-4fae-9558-4f071e992777 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:04.918160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1cf64cad-2b8d-4fae-9558-4f071e992777 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:04.939972 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4a77568e-6620-4dba-9ed6-3d79d81748c3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:04.940945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4a77568e-6620-4dba-9ed6-3d79d81748c3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:04.947438 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4a77568e-6620-4dba-9ed6-3d79d81748c3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:04.948792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4a77568e-6620-4dba-9ed6-3d79d81748c3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:04.949645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4a77568e-6620-4dba-9ed6-3d79d81748c3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:04.950080 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4a77568e-6620-4dba-9ed6-3d79d81748c3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:05.053130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1cf64cad-2b8d-4fae-9558-4f071e992777 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:05.061024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1cf64cad-2b8d-4fae-9558-4f071e992777 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.156944 Jan 11 14:16:05.061575 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 292/549] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:04 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:05.337886 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fc464813-9263-4116-ade8-8869a98106fa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:05.338945 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fc464813-9263-4116-ade8-8869a98106fa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:05.345865 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fc464813-9263-4116-ade8-8869a98106fa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:05.346487 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fc464813-9263-4116-ade8-8869a98106fa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:05.347307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fc464813-9263-4116-ade8-8869a98106fa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:05.347779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fc464813-9263-4116-ade8-8869a98106fa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:10.798263 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4a77568e-6620-4dba-9ed6-3d79d81748c3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 5.861453 Jan 11 14:16:10.799761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 258/550] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:04 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 5864 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:10.800900 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fc464813-9263-4116-ade8-8869a98106fa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 5.466916 Jan 11 14:16:10.804600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 293/551] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:05 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 5469 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:10.806407 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-698a410d-f9ac-433d-96b4-8a7cd1e0cb03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:10.807016 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-aad2c119-93b8-4475-9670-9bd039d879eb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:10.807127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-698a410d-f9ac-433d-96b4-8a7cd1e0cb03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:10.807752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-aad2c119-93b8-4475-9670-9bd039d879eb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:10.814894 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-698a410d-f9ac-433d-96b4-8a7cd1e0cb03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:10.815050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aad2c119-93b8-4475-9670-9bd039d879eb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:10.815346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aad2c119-93b8-4475-9670-9bd039d879eb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:10.815602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-698a410d-f9ac-433d-96b4-8a7cd1e0cb03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:10.816157 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-698a410d-f9ac-433d-96b4-8a7cd1e0cb03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:10.816273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aad2c119-93b8-4475-9670-9bd039d879eb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:10.816590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aad2c119-93b8-4475-9670-9bd039d879eb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:10.816693 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-698a410d-f9ac-433d-96b4-8a7cd1e0cb03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:11.013541 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-698a410d-f9ac-433d-96b4-8a7cd1e0cb03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:11.016775 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-aad2c119-93b8-4475-9670-9bd039d879eb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:11.021377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-698a410d-f9ac-433d-96b4-8a7cd1e0cb03 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.220344 Jan 11 14:16:11.021947 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 259/552] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:10 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:11.024197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-aad2c119-93b8-4475-9670-9bd039d879eb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.220954 Jan 11 14:16:11.024750 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 294/553] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:10 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:11.810631 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ff953fae-318a-479c-af4d-848262126948 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:11.811569 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ff953fae-318a-479c-af4d-848262126948 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:11.812543 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-501613dd-5b07-4595-9451-818996abbb20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:11.813446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-501613dd-5b07-4595-9451-818996abbb20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:11.817516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ff953fae-318a-479c-af4d-848262126948 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:11.817971 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ff953fae-318a-479c-af4d-848262126948 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:11.818753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ff953fae-318a-479c-af4d-848262126948 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:11.819185 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ff953fae-318a-479c-af4d-848262126948 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:11.819515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-501613dd-5b07-4595-9451-818996abbb20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:11.819978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-501613dd-5b07-4595-9451-818996abbb20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:11.820752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-501613dd-5b07-4595-9451-818996abbb20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:11.821180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-501613dd-5b07-4595-9451-818996abbb20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:11.949340 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ff953fae-318a-479c-af4d-848262126948 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.141968 Jan 11 14:16:11.949995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 260/554] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:11 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:11.952798 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-501613dd-5b07-4595-9451-818996abbb20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.144296 Jan 11 14:16:11.953605 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 295/555] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:11 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:12.039254 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c875e830-f7d7-4f31-8b2d-ef143fa1013b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:12.039984 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c875e830-f7d7-4f31-8b2d-ef143fa1013b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:12.041176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0a7a7307-889a-42e9-823c-018b00e51903 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:12.041902 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0a7a7307-889a-42e9-823c-018b00e51903 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:12.046816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c875e830-f7d7-4f31-8b2d-ef143fa1013b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.047274 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c875e830-f7d7-4f31-8b2d-ef143fa1013b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:12.048089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c875e830-f7d7-4f31-8b2d-ef143fa1013b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.048532 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c875e830-f7d7-4f31-8b2d-ef143fa1013b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:12.048676 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0a7a7307-889a-42e9-823c-018b00e51903 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.049130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0a7a7307-889a-42e9-823c-018b00e51903 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:12.049912 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0a7a7307-889a-42e9-823c-018b00e51903 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.050349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0a7a7307-889a-42e9-823c-018b00e51903 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:12.247792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c875e830-f7d7-4f31-8b2d-ef143fa1013b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:12.255053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0a7a7307-889a-42e9-823c-018b00e51903 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:12.255780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c875e830-f7d7-4f31-8b2d-ef143fa1013b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.220498 Jan 11 14:16:12.256575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 261/556] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:12 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:12.263188 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0a7a7307-889a-42e9-823c-018b00e51903 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.225912 Jan 11 14:16:12.269346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 296/557] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:12 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:12.932290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-dc5e2f69-2040-4779-bec9-e7e9e1bc7031 req-2834c59e-a1bd-4b42-bde2-f2b6aa55cac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72dedc58-795a-45be-946e-b22d685ee6c1", "name": "network-vif-plugged", "status": "completed", "tag": "097e8414-4883-4986-ba49-5f760c6cbef9"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:12.933960 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:16:12.933960 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:16:12.941799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-dc5e2f69-2040-4779-bec9-e7e9e1bc7031 req-2834c59e-a1bd-4b42-bde2-f2b6aa55cac5 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.942518 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-dc5e2f69-2040-4779-bec9-e7e9e1bc7031 req-2834c59e-a1bd-4b42-bde2-f2b6aa55cac5 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:12.957836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-dc5e2f69-2040-4779-bec9-e7e9e1bc7031 req-2834c59e-a1bd-4b42-bde2-f2b6aa55cac5 service nova] Creating event network-vif-plugged:097e8414-4883-4986-ba49-5f760c6cbef9 for instance 72dedc58-795a-45be-946e-b22d685ee6c1 on hv-cinder-82413 Jan 11 14:16:12.962986 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-dc5e2f69-2040-4779-bec9-e7e9e1bc7031 req-2834c59e-a1bd-4b42-bde2-f2b6aa55cac5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034220 Jan 11 14:16:12.963152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-46dfe5d9-0dfa-4e06-ab8d-940e3248985f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:12.963937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 262/558] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:16:12.965615 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-46dfe5d9-0dfa-4e06-ab8d-940e3248985f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:12.970221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2643802b-c05e-4210-9b99-ba6afa81d08c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:12.971184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2643802b-c05e-4210-9b99-ba6afa81d08c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:12.974272 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-46dfe5d9-0dfa-4e06-ab8d-940e3248985f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.975285 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-46dfe5d9-0dfa-4e06-ab8d-940e3248985f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:12.976104 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-46dfe5d9-0dfa-4e06-ab8d-940e3248985f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.977027 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-46dfe5d9-0dfa-4e06-ab8d-940e3248985f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:12.977613 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2643802b-c05e-4210-9b99-ba6afa81d08c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.978083 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2643802b-c05e-4210-9b99-ba6afa81d08c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:12.979182 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2643802b-c05e-4210-9b99-ba6afa81d08c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:12.979639 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2643802b-c05e-4210-9b99-ba6afa81d08c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:13.070013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-46dfe5d9-0dfa-4e06-ab8d-940e3248985f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.112396 Jan 11 14:16:13.071180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 297/559] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:12 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:13.078481 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2643802b-c05e-4210-9b99-ba6afa81d08c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.112544 Jan 11 14:16:13.079129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 263/560] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:12 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:13.274200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-dda6803e-2698-48d6-8902-1f12139a1eed tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:13.274817 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-dda6803e-2698-48d6-8902-1f12139a1eed tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:13.281156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e49c5dd7-5a50-4132-83bf-70395a79d0a7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:13.281853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e49c5dd7-5a50-4132-83bf-70395a79d0a7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:13.282480 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dda6803e-2698-48d6-8902-1f12139a1eed tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:13.282926 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dda6803e-2698-48d6-8902-1f12139a1eed tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:13.283739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dda6803e-2698-48d6-8902-1f12139a1eed tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:13.284173 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dda6803e-2698-48d6-8902-1f12139a1eed tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:13.288497 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e49c5dd7-5a50-4132-83bf-70395a79d0a7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:13.288940 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e49c5dd7-5a50-4132-83bf-70395a79d0a7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:13.289721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e49c5dd7-5a50-4132-83bf-70395a79d0a7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:13.290150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e49c5dd7-5a50-4132-83bf-70395a79d0a7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:13.483154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-dda6803e-2698-48d6-8902-1f12139a1eed tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:13.486949 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e49c5dd7-5a50-4132-83bf-70395a79d0a7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:13.491158 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-dda6803e-2698-48d6-8902-1f12139a1eed tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.221453 Jan 11 14:16:13.491762 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 298/561] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:13 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:13.494350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e49c5dd7-5a50-4132-83bf-70395a79d0a7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.219473 Jan 11 14:16:13.494898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 264/562] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:13 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:14.084203 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-565cded4-2fa5-4394-8036-38e4c0fcef5b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:14.085267 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-565cded4-2fa5-4394-8036-38e4c0fcef5b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:14.089799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f6535707-3d6f-4eda-a322-38cf1306ddf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:14.090775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f6535707-3d6f-4eda-a322-38cf1306ddf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:14.091600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-565cded4-2fa5-4394-8036-38e4c0fcef5b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:14.092057 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-565cded4-2fa5-4394-8036-38e4c0fcef5b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:14.092846 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-565cded4-2fa5-4394-8036-38e4c0fcef5b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:14.093292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-565cded4-2fa5-4394-8036-38e4c0fcef5b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:14.096871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f6535707-3d6f-4eda-a322-38cf1306ddf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:14.097325 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f6535707-3d6f-4eda-a322-38cf1306ddf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:14.098123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f6535707-3d6f-4eda-a322-38cf1306ddf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:14.098545 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f6535707-3d6f-4eda-a322-38cf1306ddf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:14.484389 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-565cded4-2fa5-4394-8036-38e4c0fcef5b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.403659 Jan 11 14:16:14.485346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 299/563] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:14 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:14.488962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f6535707-3d6f-4eda-a322-38cf1306ddf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.402614 Jan 11 14:16:14.489587 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 265/564] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:14 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:14.508186 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-897ac33b-cd13-4e76-aa55-6bb59a270353 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:14.508885 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-897ac33b-cd13-4e76-aa55-6bb59a270353 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:14.512147 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-646d29e0-5c95-4a16-a0e9-98d76c7fab1e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:14.512840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-646d29e0-5c95-4a16-a0e9-98d76c7fab1e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:14.515789 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-897ac33b-cd13-4e76-aa55-6bb59a270353 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:14.516245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-897ac33b-cd13-4e76-aa55-6bb59a270353 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:14.517023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-897ac33b-cd13-4e76-aa55-6bb59a270353 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:14.517465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-897ac33b-cd13-4e76-aa55-6bb59a270353 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:14.519452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-646d29e0-5c95-4a16-a0e9-98d76c7fab1e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:14.519936 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-646d29e0-5c95-4a16-a0e9-98d76c7fab1e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:14.520713 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-646d29e0-5c95-4a16-a0e9-98d76c7fab1e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:14.521151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-646d29e0-5c95-4a16-a0e9-98d76c7fab1e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:14.718064 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-897ac33b-cd13-4e76-aa55-6bb59a270353 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:14.721317 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-646d29e0-5c95-4a16-a0e9-98d76c7fab1e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:14.726275 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-897ac33b-cd13-4e76-aa55-6bb59a270353 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.221929 Jan 11 14:16:14.727014 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 300/565] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:14 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:14.735462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-646d29e0-5c95-4a16-a0e9-98d76c7fab1e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.227039 Jan 11 14:16:14.736219 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 266/566] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:14 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:15.495236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7bd81e58-2551-4af7-b5b5-c1036a9f7160 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:15.496212 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7bd81e58-2551-4af7-b5b5-c1036a9f7160 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:15.500741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6a075112-3b10-4817-bdaf-1c884f1c7046 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:15.501645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6a075112-3b10-4817-bdaf-1c884f1c7046 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:15.503052 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bd81e58-2551-4af7-b5b5-c1036a9f7160 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:15.503519 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bd81e58-2551-4af7-b5b5-c1036a9f7160 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:15.504313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bd81e58-2551-4af7-b5b5-c1036a9f7160 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:15.504745 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7bd81e58-2551-4af7-b5b5-c1036a9f7160 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:15.507771 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6a075112-3b10-4817-bdaf-1c884f1c7046 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:15.508222 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6a075112-3b10-4817-bdaf-1c884f1c7046 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:15.508999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6a075112-3b10-4817-bdaf-1c884f1c7046 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:15.509432 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6a075112-3b10-4817-bdaf-1c884f1c7046 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:19.730153 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6a075112-3b10-4817-bdaf-1c884f1c7046 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 4.233495 Jan 11 14:16:19.731400 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 267/567] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:15 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 4236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:19.733969 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7bd81e58-2551-4af7-b5b5-c1036a9f7160 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 4.242145 Jan 11 14:16:19.734955 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 301/568] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:15 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 4244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:19.736556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-75a6bfe2-25a4-4561-9f56-5ddccffec646 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:19.737245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-75a6bfe2-25a4-4561-9f56-5ddccffec646 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:19.739685 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e71d9645-245b-44c3-8af1-98b8de363ce4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:19.740431 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e71d9645-245b-44c3-8af1-98b8de363ce4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:19.744354 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-75a6bfe2-25a4-4561-9f56-5ddccffec646 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:19.744806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-75a6bfe2-25a4-4561-9f56-5ddccffec646 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:19.745595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-75a6bfe2-25a4-4561-9f56-5ddccffec646 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:19.746068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-75a6bfe2-25a4-4561-9f56-5ddccffec646 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:19.747159 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e71d9645-245b-44c3-8af1-98b8de363ce4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:19.747636 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e71d9645-245b-44c3-8af1-98b8de363ce4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:19.748424 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e71d9645-245b-44c3-8af1-98b8de363ce4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:19.748858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e71d9645-245b-44c3-8af1-98b8de363ce4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:20.015256 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e71d9645-245b-44c3-8af1-98b8de363ce4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:20.022770 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e71d9645-245b-44c3-8af1-98b8de363ce4 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1318 microversion: 2.1 time: 0.286819 Jan 11 14:16:20.023068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-75a6bfe2-25a4-4561-9f56-5ddccffec646 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:20.023335 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 302/569] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:19 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:20.031276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-75a6bfe2-25a4-4561-9f56-5ddccffec646 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.298570 Jan 11 14:16:20.031941 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 268/570] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:19 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:20.742724 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-70fe66ff-e6cf-4bb0-854a-81bc98aba563 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:20.743759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-70fe66ff-e6cf-4bb0-854a-81bc98aba563 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:20.745560 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f4adb23c-1a19-4d5c-b527-519c69166017 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:20.746494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f4adb23c-1a19-4d5c-b527-519c69166017 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:20.750790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70fe66ff-e6cf-4bb0-854a-81bc98aba563 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:20.751286 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70fe66ff-e6cf-4bb0-854a-81bc98aba563 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:20.752212 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70fe66ff-e6cf-4bb0-854a-81bc98aba563 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:20.752652 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70fe66ff-e6cf-4bb0-854a-81bc98aba563 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:20.755039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4adb23c-1a19-4d5c-b527-519c69166017 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:20.755519 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4adb23c-1a19-4d5c-b527-519c69166017 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:20.756294 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4adb23c-1a19-4d5c-b527-519c69166017 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:20.756728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4adb23c-1a19-4d5c-b527-519c69166017 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:20.826305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f4adb23c-1a19-4d5c-b527-519c69166017 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.084709 Jan 11 14:16:20.826950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 269/571] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:20 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:20.862064 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-70fe66ff-e6cf-4bb0-854a-81bc98aba563 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.123180 Jan 11 14:16:20.862701 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 303/572] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:20 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:20.998461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-434924156", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "d319b443-645e-432a-b025-0fae1ca27645"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:21.039661 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e1a16f91-8c66-4b24-aba7-a37e865eb6ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:21.040363 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e1a16f91-8c66-4b24-aba7-a37e865eb6ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:21.057445 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1a16f91-8c66-4b24-aba7-a37e865eb6ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.057899 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1a16f91-8c66-4b24-aba7-a37e865eb6ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.058692 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1a16f91-8c66-4b24-aba7-a37e865eb6ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.059806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1a16f91-8c66-4b24-aba7-a37e865eb6ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.076907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] validate_networks() for [('d319b443-645e-432a-b025-0fae1ca27645', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:16:21.302807 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e1a16f91-8c66-4b24-aba7-a37e865eb6ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:21.310829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e1a16f91-8c66-4b24-aba7-a37e865eb6ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1509 microversion: 2.1 time: 0.275407 Jan 11 14:16:21.311391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 304/573] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:21 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:21.315765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a2bef016-fccb-45ad-ba8d-c099357983c0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:21.316391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a2bef016-fccb-45ad-ba8d-c099357983c0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:21.322382 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a2bef016-fccb-45ad-ba8d-c099357983c0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.322832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a2bef016-fccb-45ad-ba8d-c099357983c0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.323903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a2bef016-fccb-45ad-ba8d-c099357983c0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.324333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a2bef016-fccb-45ad-ba8d-c099357983c0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.540810 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a2bef016-fccb-45ad-ba8d-c099357983c0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:21.555973 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a2bef016-fccb-45ad-ba8d-c099357983c0 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1567 microversion: 2.1 time: 0.243356 Jan 11 14:16:21.565462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 305/574] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:21 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:21.568194 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:16:21.568995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:16:21.569472 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:16:21.570065 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:16:21.570497 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:16:21.579951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.580406 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.581219 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.581653 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.601793 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Getting quotas for project 2b10949b6e5a439990bd8563f61eca19. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:16:21.605817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Getting quotas for user 03bd3500319e438693757912c1938a57 and project 2b10949b6e5a439990bd8563f61eca19. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:16:21.616635 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:16:21.619120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:16:21.663624 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e05e25c2-6b02-481b-b39d-89bd8af4c1b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669195 Jan 11 14:16:21.664268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 270/575] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 14:16:21.674614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8389f27d-478c-42b0-ab37-40031da19e0c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:21.675450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8389f27d-478c-42b0-ab37-40031da19e0c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:21.739338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8389f27d-478c-42b0-ab37-40031da19e0c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:21.746747 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8389f27d-478c-42b0-ab37-40031da19e0c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1218 microversion: 2.1 time: 0.076107 Jan 11 14:16:21.747634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 306/576] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:21 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:21.837498 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0bbc6492-c21a-484d-8f38-16e275f04130 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:21.838590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0bbc6492-c21a-484d-8f38-16e275f04130 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:21.844948 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0bbc6492-c21a-484d-8f38-16e275f04130 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.845599 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0bbc6492-c21a-484d-8f38-16e275f04130 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.846556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0bbc6492-c21a-484d-8f38-16e275f04130 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.846995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0bbc6492-c21a-484d-8f38-16e275f04130 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.874556 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4d02bfd1-b031-45b3-a125-970034294d9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:21.875610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4d02bfd1-b031-45b3-a125-970034294d9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:21.882086 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4d02bfd1-b031-45b3-a125-970034294d9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.882548 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4d02bfd1-b031-45b3-a125-970034294d9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.883307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4d02bfd1-b031-45b3-a125-970034294d9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:21.883765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4d02bfd1-b031-45b3-a125-970034294d9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:21.935368 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0bbc6492-c21a-484d-8f38-16e275f04130 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.101490 Jan 11 14:16:21.936554 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 271/577] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:21 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:21.955271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4d02bfd1-b031-45b3-a125-970034294d9b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.085068 Jan 11 14:16:21.956002 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 307/578] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:21 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:22.573831 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-714c64c6-8fb6-4e66-ba2b-bff204902280 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:22.574521 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-714c64c6-8fb6-4e66-ba2b-bff204902280 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:22.581229 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-714c64c6-8fb6-4e66-ba2b-bff204902280 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.581676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-714c64c6-8fb6-4e66-ba2b-bff204902280 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.582439 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-714c64c6-8fb6-4e66-ba2b-bff204902280 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.582871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-714c64c6-8fb6-4e66-ba2b-bff204902280 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.642856 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-55491fcc-d4e8-41ec-98e1-1fcef4469b5f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd62da11-1b98-4fb6-8d6b-f437c245a60a"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:22.644040 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-55491fcc-d4e8-41ec-98e1-1fcef4469b5f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:22.650771 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-55491fcc-d4e8-41ec-98e1-1fcef4469b5f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.651212 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-55491fcc-d4e8-41ec-98e1-1fcef4469b5f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.652021 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-55491fcc-d4e8-41ec-98e1-1fcef4469b5f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.652456 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-55491fcc-d4e8-41ec-98e1-1fcef4469b5f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.713196 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-714c64c6-8fb6-4e66-ba2b-bff204902280 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:22.721890 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-714c64c6-8fb6-4e66-ba2b-bff204902280 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1547 microversion: 2.1 time: 0.152291 Jan 11 14:16:22.722445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 272/579] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:22 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:22.738819 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:22.739450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:22.745738 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.746272 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.747161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.747728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.843061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] HTTP exception thrown: Cannot 'detach_volume' instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 while it is in vm_state rescued Jan 11 14:16:22.843763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Returning 409 to user: Cannot 'detach_volume' instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 while it is in vm_state rescued {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:16:22.844668 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4b47e54a-9ed8-405b-8067-31660a93c9b8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "DELETE /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments/63529041-3e64-4ec5-8483-93d9be732945" status: 409 len: 152 microversion: 2.1 time: 0.110186 Jan 11 14:16:22.845405 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 273/580] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:16:22 2022] DELETE /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments/63529041-3e64-4ec5-8483-93d9be732945 => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 11 14:16:22.850678 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-47521eff-aefd-4cd1-931c-32661ff3bb9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:22.851515 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-47521eff-aefd-4cd1-931c-32661ff3bb9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:22.859226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-47521eff-aefd-4cd1-931c-32661ff3bb9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.859672 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-47521eff-aefd-4cd1-931c-32661ff3bb9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.860505 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-47521eff-aefd-4cd1-931c-32661ff3bb9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.860937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-47521eff-aefd-4cd1-931c-32661ff3bb9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.953979 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-55491fcc-d4e8-41ec-98e1-1fcef4469b5f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314704 Jan 11 14:16:22.954762 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 308/581] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:16:22 2022] POST /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:16:22.962530 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d09f7ee6-f9c8-49ca-8e29-0ef8961db34e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:22.963773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d09f7ee6-f9c8-49ca-8e29-0ef8961db34e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:22.974290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-47521eff-aefd-4cd1-931c-32661ff3bb9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:22.985225 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-47521eff-aefd-4cd1-931c-32661ff3bb9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1278 microversion: 2.1 time: 0.137341 Jan 11 14:16:22.985656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d09f7ee6-f9c8-49ca-8e29-0ef8961db34e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.987006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d09f7ee6-f9c8-49ca-8e29-0ef8961db34e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.987428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 274/582] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:22 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:22.989611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d09f7ee6-f9c8-49ca-8e29-0ef8961db34e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:22.990217 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d09f7ee6-f9c8-49ca-8e29-0ef8961db34e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:22.998892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-95b85ca0-5f26-4802-9d13-aac5de06067f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:23.005838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-95b85ca0-5f26-4802-9d13-aac5de06067f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:23.013356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95b85ca0-5f26-4802-9d13-aac5de06067f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:23.013810 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95b85ca0-5f26-4802-9d13-aac5de06067f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:23.014621 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95b85ca0-5f26-4802-9d13-aac5de06067f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:23.015063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-95b85ca0-5f26-4802-9d13-aac5de06067f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:23.106423 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d09f7ee6-f9c8-49ca-8e29-0ef8961db34e tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/action" status: 202 len: 0 microversion: 2.1 time: 0.148598 Jan 11 14:16:23.107700 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 309/583] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:22 2022] POST /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:23.114321 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6f1f2ff5-02f5-4a80-aec7-6076da4fdb74 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:23.116234 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6f1f2ff5-02f5-4a80-aec7-6076da4fdb74 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:23.124429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f1f2ff5-02f5-4a80-aec7-6076da4fdb74 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:23.125102 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f1f2ff5-02f5-4a80-aec7-6076da4fdb74 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:23.126963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f1f2ff5-02f5-4a80-aec7-6076da4fdb74 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:23.127713 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f1f2ff5-02f5-4a80-aec7-6076da4fdb74 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:23.131893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-95b85ca0-5f26-4802-9d13-aac5de06067f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.142980 Jan 11 14:16:23.132538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 275/584] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:22 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:23.139180 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dd9a5bb9-734e-48a6-a1df-20b45d701271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:23.140523 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dd9a5bb9-734e-48a6-a1df-20b45d701271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:23.149509 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd9a5bb9-734e-48a6-a1df-20b45d701271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:23.150241 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd9a5bb9-734e-48a6-a1df-20b45d701271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:23.151567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd9a5bb9-734e-48a6-a1df-20b45d701271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:23.152270 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd9a5bb9-734e-48a6-a1df-20b45d701271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:23.223854 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6f1f2ff5-02f5-4a80-aec7-6076da4fdb74 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.114521 Jan 11 14:16:23.224490 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 310/585] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:23 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:23.480438 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dd9a5bb9-734e-48a6-a1df-20b45d701271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:23.488803 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dd9a5bb9-734e-48a6-a1df-20b45d701271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1555 microversion: 2.1 time: 0.354724 Jan 11 14:16:23.489386 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 276/586] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:23 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1555 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:24.004009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f17cdfb2-26b0-4c29-8fd0-cd99e6c65110 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:24.004843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f17cdfb2-26b0-4c29-8fd0-cd99e6c65110 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:24.013023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f17cdfb2-26b0-4c29-8fd0-cd99e6c65110 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:24.014005 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f17cdfb2-26b0-4c29-8fd0-cd99e6c65110 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:24.014951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f17cdfb2-26b0-4c29-8fd0-cd99e6c65110 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:24.015660 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f17cdfb2-26b0-4c29-8fd0-cd99e6c65110 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:24.144390 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4a8b255d-b310-4ff3-a682-c6dc6bdc6b11 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:24.145536 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4a8b255d-b310-4ff3-a682-c6dc6bdc6b11 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:24.152908 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4a8b255d-b310-4ff3-a682-c6dc6bdc6b11 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:24.153359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4a8b255d-b310-4ff3-a682-c6dc6bdc6b11 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:24.154145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4a8b255d-b310-4ff3-a682-c6dc6bdc6b11 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:24.154576 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4a8b255d-b310-4ff3-a682-c6dc6bdc6b11 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:24.224347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4a8b255d-b310-4ff3-a682-c6dc6bdc6b11 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.083433 Jan 11 14:16:24.225422 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 277/587] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:24 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:24.235916 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-917b5858-c35f-4f98-a491-9890d147cf7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:24.237010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-917b5858-c35f-4f98-a491-9890d147cf7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:24.244382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-917b5858-c35f-4f98-a491-9890d147cf7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:24.244878 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-917b5858-c35f-4f98-a491-9890d147cf7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:24.245761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-917b5858-c35f-4f98-a491-9890d147cf7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:24.246259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-917b5858-c35f-4f98-a491-9890d147cf7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:24.316335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-917b5858-c35f-4f98-a491-9890d147cf7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.084231 Jan 11 14:16:24.316981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 278/588] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:24 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:24.438194 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f17cdfb2-26b0-4c29-8fd0-cd99e6c65110 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:24.445437 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f17cdfb2-26b0-4c29-8fd0-cd99e6c65110 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.445543 Jan 11 14:16:24.446090 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 311/589] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:23 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:24.506723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-509d024a-e426-4b8d-91a5-36beb62fd271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:24.507331 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-509d024a-e426-4b8d-91a5-36beb62fd271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:24.514025 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-509d024a-e426-4b8d-91a5-36beb62fd271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:24.514470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-509d024a-e426-4b8d-91a5-36beb62fd271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:24.515242 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-509d024a-e426-4b8d-91a5-36beb62fd271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:24.515701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-509d024a-e426-4b8d-91a5-36beb62fd271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:24.719450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-509d024a-e426-4b8d-91a5-36beb62fd271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:24.727195 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-509d024a-e426-4b8d-91a5-36beb62fd271 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1555 microversion: 2.1 time: 0.224531 Jan 11 14:16:24.727788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 279/590] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:24 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:25.008681 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-96adc242-b53c-4e46-bcfa-36aaede3f13d req-e2cee4eb-6898-4615-8359-52ceaa7404a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f638f3d-a3ed-4ba6-9310-81ab620fe882", "tag": "8232801e-c8a6-4b58-9700-b2811cddf236"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:25.010222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:16:25.010222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:16:25.018135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-96adc242-b53c-4e46-bcfa-36aaede3f13d req-e2cee4eb-6898-4615-8359-52ceaa7404a1 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.018580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-96adc242-b53c-4e46-bcfa-36aaede3f13d req-e2cee4eb-6898-4615-8359-52ceaa7404a1 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.033769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-96adc242-b53c-4e46-bcfa-36aaede3f13d req-e2cee4eb-6898-4615-8359-52ceaa7404a1 service nova] Creating event network-changed:8232801e-c8a6-4b58-9700-b2811cddf236 for instance 8f638f3d-a3ed-4ba6-9310-81ab620fe882 on hv-cinder-82413 Jan 11 14:16:25.039254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-96adc242-b53c-4e46-bcfa-36aaede3f13d req-e2cee4eb-6898-4615-8359-52ceaa7404a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034203 Jan 11 14:16:25.039888 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 312/591] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:16:25.236918 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ba599bf9-a461-4b11-b81c-54fa6aaa607e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:25.237882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ba599bf9-a461-4b11-b81c-54fa6aaa607e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:25.244024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba599bf9-a461-4b11-b81c-54fa6aaa607e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.244473 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba599bf9-a461-4b11-b81c-54fa6aaa607e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.245256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba599bf9-a461-4b11-b81c-54fa6aaa607e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.245691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba599bf9-a461-4b11-b81c-54fa6aaa607e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.316210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ba599bf9-a461-4b11-b81c-54fa6aaa607e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.082680 Jan 11 14:16:25.320043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 280/592] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:25 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:25.329241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7951857e-ec07-4e0a-a6f0-fd16ca0b8c30 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:25.330505 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7951857e-ec07-4e0a-a6f0-fd16ca0b8c30 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:25.336521 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7951857e-ec07-4e0a-a6f0-fd16ca0b8c30 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.336969 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7951857e-ec07-4e0a-a6f0-fd16ca0b8c30 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.337743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7951857e-ec07-4e0a-a6f0-fd16ca0b8c30 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.338183 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7951857e-ec07-4e0a-a6f0-fd16ca0b8c30 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.463020 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7e6aa2a6-5a53-4858-a640-d3f46269515b tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:25.463752 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7e6aa2a6-5a53-4858-a640-d3f46269515b tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:25.471323 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e6aa2a6-5a53-4858-a640-d3f46269515b tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.472468 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e6aa2a6-5a53-4858-a640-d3f46269515b tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.473285 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e6aa2a6-5a53-4858-a640-d3f46269515b tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.473730 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e6aa2a6-5a53-4858-a640-d3f46269515b tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.674350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7e6aa2a6-5a53-4858-a640-d3f46269515b tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:25.681523 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7e6aa2a6-5a53-4858-a640-d3f46269515b tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.222607 Jan 11 14:16:25.682095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 281/593] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:25 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:25.745230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c613e907-ca36-499c-b44c-176275b07c8d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:25.745849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c613e907-ca36-499c-b44c-176275b07c8d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:25.752707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c613e907-ca36-499c-b44c-176275b07c8d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.753160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c613e907-ca36-499c-b44c-176275b07c8d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.753948 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c613e907-ca36-499c-b44c-176275b07c8d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:25.754388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c613e907-ca36-499c-b44c-176275b07c8d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:25.842953 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:16:25.843147 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: Tue Jan 11 14:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 (ip 10.222.0.49) !!! Jan 11 14:16:25.979780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c613e907-ca36-499c-b44c-176275b07c8d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:25.988209 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c613e907-ca36-499c-b44c-176275b07c8d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1555 microversion: 2.1 time: 0.246766 Jan 11 14:16:25.988775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 282/594] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:25 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:26.327774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-37a48a31-c7d8-492f-817f-c0fafa04081b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:26.328733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-37a48a31-c7d8-492f-817f-c0fafa04081b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:26.334855 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-37a48a31-c7d8-492f-817f-c0fafa04081b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:26.335303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-37a48a31-c7d8-492f-817f-c0fafa04081b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:26.336121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-37a48a31-c7d8-492f-817f-c0fafa04081b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:26.336556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-37a48a31-c7d8-492f-817f-c0fafa04081b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:26.392470 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7951857e-ec07-4e0a-a6f0-fd16ca0b8c30 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 1.067554 Jan 11 14:16:26.393037 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 313/595] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:25 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:26.426643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-37a48a31-c7d8-492f-817f-c0fafa04081b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.102722 Jan 11 14:16:26.427262 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 283/596] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:26 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:26.699185 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4bdccb72-d93b-40f0-b101-448da4e6abd6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:26.700392 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4bdccb72-d93b-40f0-b101-448da4e6abd6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:26.707250 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4bdccb72-d93b-40f0-b101-448da4e6abd6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:26.707728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4bdccb72-d93b-40f0-b101-448da4e6abd6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:26.708505 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4bdccb72-d93b-40f0-b101-448da4e6abd6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:26.708938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4bdccb72-d93b-40f0-b101-448da4e6abd6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:26.839368 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4bdccb72-d93b-40f0-b101-448da4e6abd6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:26.847831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4bdccb72-d93b-40f0-b101-448da4e6abd6 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.152895 Jan 11 14:16:26.848391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 314/597] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:26 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:27.004928 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-eb5c9889-7803-41d1-a660-8c96cfb7db01 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:27.005560 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-eb5c9889-7803-41d1-a660-8c96cfb7db01 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:27.012847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb5c9889-7803-41d1-a660-8c96cfb7db01 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:27.013294 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb5c9889-7803-41d1-a660-8c96cfb7db01 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:27.014067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb5c9889-7803-41d1-a660-8c96cfb7db01 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:27.014503 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb5c9889-7803-41d1-a660-8c96cfb7db01 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:27.140846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-eb5c9889-7803-41d1-a660-8c96cfb7db01 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:27.149103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-eb5c9889-7803-41d1-a660-8c96cfb7db01 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1555 microversion: 2.1 time: 0.148260 Jan 11 14:16:27.149665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 284/598] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:26 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:27.403837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f80053c1-112e-4d78-b2b2-31bd420be7d8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:27.404752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f80053c1-112e-4d78-b2b2-31bd420be7d8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:27.410903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f80053c1-112e-4d78-b2b2-31bd420be7d8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:27.411358 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f80053c1-112e-4d78-b2b2-31bd420be7d8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:27.412172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f80053c1-112e-4d78-b2b2-31bd420be7d8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:27.412610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f80053c1-112e-4d78-b2b2-31bd420be7d8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:27.438273 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8f49e3c9-9b60-4a9d-b118-12578fb0d4d2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:27.439243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8f49e3c9-9b60-4a9d-b118-12578fb0d4d2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:27.445318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f49e3c9-9b60-4a9d-b118-12578fb0d4d2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:27.445761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f49e3c9-9b60-4a9d-b118-12578fb0d4d2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:27.446557 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f49e3c9-9b60-4a9d-b118-12578fb0d4d2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:27.446991 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f49e3c9-9b60-4a9d-b118-12578fb0d4d2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:27.510032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f80053c1-112e-4d78-b2b2-31bd420be7d8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.109693 Jan 11 14:16:27.510691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 315/599] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:27 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:27.548616 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8f49e3c9-9b60-4a9d-b118-12578fb0d4d2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.114375 Jan 11 14:16:27.549234 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 285/600] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:27 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:27.863757 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4833fcd1-11f7-47ab-bf7f-349509bb291a tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:27.864576 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4833fcd1-11f7-47ab-bf7f-349509bb291a tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:27.871563 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4833fcd1-11f7-47ab-bf7f-349509bb291a tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:27.872008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4833fcd1-11f7-47ab-bf7f-349509bb291a tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:27.872779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4833fcd1-11f7-47ab-bf7f-349509bb291a tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:27.873206 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4833fcd1-11f7-47ab-bf7f-349509bb291a tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:28.004360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4833fcd1-11f7-47ab-bf7f-349509bb291a tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:28.012284 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4833fcd1-11f7-47ab-bf7f-349509bb291a tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.152723 Jan 11 14:16:28.012839 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 316/601] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:27 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:28.166103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-34446d49-7361-41e6-a117-cfa6ac7d2262 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:28.166788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-34446d49-7361-41e6-a117-cfa6ac7d2262 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:28.174293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34446d49-7361-41e6-a117-cfa6ac7d2262 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:28.174732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34446d49-7361-41e6-a117-cfa6ac7d2262 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:28.175627 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34446d49-7361-41e6-a117-cfa6ac7d2262 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:28.175950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34446d49-7361-41e6-a117-cfa6ac7d2262 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:28.311315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-34446d49-7361-41e6-a117-cfa6ac7d2262 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:28.319068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-34446d49-7361-41e6-a117-cfa6ac7d2262 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1555 microversion: 2.1 time: 0.156892 Jan 11 14:16:28.319655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 286/602] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:28 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:28.521614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-50ef0bbe-ff5e-411c-ac04-abc5da4aad15 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:28.522431 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-50ef0bbe-ff5e-411c-ac04-abc5da4aad15 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:28.531376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-50ef0bbe-ff5e-411c-ac04-abc5da4aad15 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:28.532031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-50ef0bbe-ff5e-411c-ac04-abc5da4aad15 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:28.533109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-50ef0bbe-ff5e-411c-ac04-abc5da4aad15 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:28.533674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-50ef0bbe-ff5e-411c-ac04-abc5da4aad15 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:28.561078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-364aaf3b-689b-45e2-9754-f12b403ec538 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:28.562012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-364aaf3b-689b-45e2-9754-f12b403ec538 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:28.568155 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-364aaf3b-689b-45e2-9754-f12b403ec538 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:28.568620 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-364aaf3b-689b-45e2-9754-f12b403ec538 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:28.569392 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-364aaf3b-689b-45e2-9754-f12b403ec538 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:28.569822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-364aaf3b-689b-45e2-9754-f12b403ec538 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:28.596122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-50ef0bbe-ff5e-411c-ac04-abc5da4aad15 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.078012 Jan 11 14:16:28.596759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 317/603] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:28 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:28.953170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-364aaf3b-689b-45e2-9754-f12b403ec538 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.396837 Jan 11 14:16:28.953804 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 287/604] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:28 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:29.028527 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c6db075d-a084-412d-b10f-fd5d59d85436 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:29.029223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c6db075d-a084-412d-b10f-fd5d59d85436 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:29.036217 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c6db075d-a084-412d-b10f-fd5d59d85436 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.036669 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c6db075d-a084-412d-b10f-fd5d59d85436 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.037448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c6db075d-a084-412d-b10f-fd5d59d85436 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.037883 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c6db075d-a084-412d-b10f-fd5d59d85436 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.166731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c6db075d-a084-412d-b10f-fd5d59d85436 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:29.174345 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c6db075d-a084-412d-b10f-fd5d59d85436 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.149837 Jan 11 14:16:29.174920 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 318/605] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:29 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:29.336774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4e0e9423-507f-4e22-aa13-496dd83cdf24 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:29.337477 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4e0e9423-507f-4e22-aa13-496dd83cdf24 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:29.344339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4e0e9423-507f-4e22-aa13-496dd83cdf24 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.344793 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4e0e9423-507f-4e22-aa13-496dd83cdf24 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.345574 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4e0e9423-507f-4e22-aa13-496dd83cdf24 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.346021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4e0e9423-507f-4e22-aa13-496dd83cdf24 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.476576 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4e0e9423-507f-4e22-aa13-496dd83cdf24 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:29.484967 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4e0e9423-507f-4e22-aa13-496dd83cdf24 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1561 microversion: 2.1 time: 0.152143 Jan 11 14:16:29.485598 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 288/606] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:29 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:29.548726 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a35a9438-9ca8-450b-8045-5c6538f3ac35 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:29.549213 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a35a9438-9ca8-450b-8045-5c6538f3ac35 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:29.555340 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a35a9438-9ca8-450b-8045-5c6538f3ac35 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.555837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a35a9438-9ca8-450b-8045-5c6538f3ac35 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.556619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a35a9438-9ca8-450b-8045-5c6538f3ac35 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.557058 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a35a9438-9ca8-450b-8045-5c6538f3ac35 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.607598 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7e3a31d2-cfd4-42b2-8d11-8341e530675c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:29.608526 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7e3a31d2-cfd4-42b2-8d11-8341e530675c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:29.614549 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e3a31d2-cfd4-42b2-8d11-8341e530675c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.614992 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e3a31d2-cfd4-42b2-8d11-8341e530675c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.615790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e3a31d2-cfd4-42b2-8d11-8341e530675c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.616221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e3a31d2-cfd4-42b2-8d11-8341e530675c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.634038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-a35a9438-9ca8-450b-8045-5c6538f3ac35 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lazy-loading 'services' on Instance uuid efdb5bf8-cc2d-4e01-ad4d-6a9647801384 {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:16:29.702199 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a35a9438-9ca8-450b-8045-5c6538f3ac35 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "DELETE /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments/63529041-3e64-4ec5-8483-93d9be732945" status: 202 len: 0 microversion: 2.1 time: 0.156978 Jan 11 14:16:29.702784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 319/607] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:16:29 2022] DELETE /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments/63529041-3e64-4ec5-8483-93d9be732945 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:29.710917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-27647e6f-b191-4df6-96c6-62c0694eb0f2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:29.711984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-27647e6f-b191-4df6-96c6-62c0694eb0f2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:29.718019 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27647e6f-b191-4df6-96c6-62c0694eb0f2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.718463 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27647e6f-b191-4df6-96c6-62c0694eb0f2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.719230 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27647e6f-b191-4df6-96c6-62c0694eb0f2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.719697 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27647e6f-b191-4df6-96c6-62c0694eb0f2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.743408 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7e3a31d2-cfd4-42b2-8d11-8341e530675c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.139400 Jan 11 14:16:29.746795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 289/608] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:29 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:29.749587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-27647e6f-b191-4df6-96c6-62c0694eb0f2 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042388 Jan 11 14:16:29.750151 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 320/609] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:16:29 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:16:29.965000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-76229e8a-2a29-4ef7-bd34-9604ef92a006 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:29.965901 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-76229e8a-2a29-4ef7-bd34-9604ef92a006 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:29.972625 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-76229e8a-2a29-4ef7-bd34-9604ef92a006 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.973069 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-76229e8a-2a29-4ef7-bd34-9604ef92a006 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:29.973838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-76229e8a-2a29-4ef7-bd34-9604ef92a006 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:29.974271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-76229e8a-2a29-4ef7-bd34-9604ef92a006 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:30.035555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-76229e8a-2a29-4ef7-bd34-9604ef92a006 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.074731 Jan 11 14:16:30.036158 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 290/610] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:29 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:30.190709 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-09b68604-86a8-488c-a359-6c94cc36a3ad tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:30.191311 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-09b68604-86a8-488c-a359-6c94cc36a3ad tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:30.197613 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-09b68604-86a8-488c-a359-6c94cc36a3ad tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:30.198063 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-09b68604-86a8-488c-a359-6c94cc36a3ad tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:30.199087 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-09b68604-86a8-488c-a359-6c94cc36a3ad tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:30.199534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-09b68604-86a8-488c-a359-6c94cc36a3ad tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:30.326002 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-09b68604-86a8-488c-a359-6c94cc36a3ad tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:30.333475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-09b68604-86a8-488c-a359-6c94cc36a3ad tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.146386 Jan 11 14:16:30.334031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 321/611] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:30 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:30.756976 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5a79af37-2902-4494-852a-da49ea61ffe9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:30.757970 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5a79af37-2902-4494-852a-da49ea61ffe9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:30.760836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a00e0372-8ede-46ac-8a36-0a8ad20512ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:30.762380 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a00e0372-8ede-46ac-8a36-0a8ad20512ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:30.765427 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a79af37-2902-4494-852a-da49ea61ffe9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:30.765876 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a79af37-2902-4494-852a-da49ea61ffe9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:30.766687 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a79af37-2902-4494-852a-da49ea61ffe9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:30.767121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a79af37-2902-4494-852a-da49ea61ffe9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:30.769187 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a00e0372-8ede-46ac-8a36-0a8ad20512ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:30.769647 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a00e0372-8ede-46ac-8a36-0a8ad20512ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:30.770422 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a00e0372-8ede-46ac-8a36-0a8ad20512ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:30.770858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a00e0372-8ede-46ac-8a36-0a8ad20512ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:30.803902 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a00e0372-8ede-46ac-8a36-0a8ad20512ef tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046747 Jan 11 14:16:30.804381 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 322/612] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:16:30 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:16:30.841768 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5a79af37-2902-4494-852a-da49ea61ffe9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.088891 Jan 11 14:16:30.842476 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 291/613] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:30 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:31.047323 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-94ddfb93-53b5-490d-87f1-6156d1f4c697 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:31.048342 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-94ddfb93-53b5-490d-87f1-6156d1f4c697 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:31.054621 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-94ddfb93-53b5-490d-87f1-6156d1f4c697 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.055009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-94ddfb93-53b5-490d-87f1-6156d1f4c697 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.055812 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-94ddfb93-53b5-490d-87f1-6156d1f4c697 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.056240 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-94ddfb93-53b5-490d-87f1-6156d1f4c697 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.129130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-94ddfb93-53b5-490d-87f1-6156d1f4c697 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.086389 Jan 11 14:16:31.129808 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 323/614] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:31 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:31.351101 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5fad6240-4179-48cb-9951-124f3c34838f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:31.351861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5fad6240-4179-48cb-9951-124f3c34838f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:31.359283 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5fad6240-4179-48cb-9951-124f3c34838f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.359754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5fad6240-4179-48cb-9951-124f3c34838f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.360538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5fad6240-4179-48cb-9951-124f3c34838f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.360972 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5fad6240-4179-48cb-9951-124f3c34838f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.481743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd62da11-1b98-4fb6-8d6b-f437c245a60a"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:31.483008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:31.490031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.490851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.492423 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.493223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.494853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5fad6240-4179-48cb-9951-124f3c34838f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:31.507530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5fad6240-4179-48cb-9951-124f3c34838f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.160546 Jan 11 14:16:31.508116 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 292/615] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:31 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:31.579656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] HTTP exception thrown: Invalid volume: volume dd62da11-1b98-4fb6-8d6b-f437c245a60a is already attached to instances: 72dedc58-795a-45be-946e-b22d685ee6c1 Jan 11 14:16:31.580344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Returning 400 to user: Invalid volume: volume dd62da11-1b98-4fb6-8d6b-f437c245a60a is already attached to instances: 72dedc58-795a-45be-946e-b22d685ee6c1 {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:16:31.581356 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f8a4fd76-ec1f-465d-9ef8-6d83f5d94b63 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104439 Jan 11 14:16:31.582255 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 324/616] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:16:31 2022] POST /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 11 14:16:31.638247 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ea0b94c2-bc48-453d-aa0a-9a23be219303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:31.638747 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ea0b94c2-bc48-453d-aa0a-9a23be219303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:31.644861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ea0b94c2-bc48-453d-aa0a-9a23be219303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.645312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ea0b94c2-bc48-453d-aa0a-9a23be219303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.646092 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ea0b94c2-bc48-453d-aa0a-9a23be219303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.646522 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ea0b94c2-bc48-453d-aa0a-9a23be219303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.722559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-ea0b94c2-bc48-453d-aa0a-9a23be219303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lazy-loading 'services' on Instance uuid 72dedc58-795a-45be-946e-b22d685ee6c1 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:16:31.791229 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ea0b94c2-bc48-453d-aa0a-9a23be219303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "DELETE /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments/dd62da11-1b98-4fb6-8d6b-f437c245a60a" status: 202 len: 0 microversion: 2.1 time: 0.156548 Jan 11 14:16:31.792012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 293/617] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:16:31 2022] DELETE /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments/dd62da11-1b98-4fb6-8d6b-f437c245a60a => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:31.800619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-47ec9f07-7ed8-4bf8-8022-0ad66f0a2158 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:31.801617 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-47ec9f07-7ed8-4bf8-8022-0ad66f0a2158 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:31.808766 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-47ec9f07-7ed8-4bf8-8022-0ad66f0a2158 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.809415 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-47ec9f07-7ed8-4bf8-8022-0ad66f0a2158 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.810420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-47ec9f07-7ed8-4bf8-8022-0ad66f0a2158 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.810857 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-47ec9f07-7ed8-4bf8-8022-0ad66f0a2158 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.816005 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a8775881-0c56-47e3-8c28-78e31dc1617c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:31.817072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a8775881-0c56-47e3-8c28-78e31dc1617c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:31.825201 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a8775881-0c56-47e3-8c28-78e31dc1617c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.825645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a8775881-0c56-47e3-8c28-78e31dc1617c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.826429 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a8775881-0c56-47e3-8c28-78e31dc1617c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.826858 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a8775881-0c56-47e3-8c28-78e31dc1617c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.841083 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-47ec9f07-7ed8-4bf8-8022-0ad66f0a2158 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Jan 11 14:16:31.841644 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 325/618] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:16:31 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:16:31.854054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b515269a-e9e3-4caf-ab75-75eeb5a0b59f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:31.854988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b515269a-e9e3-4caf-ab75-75eeb5a0b59f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:31.857861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a8775881-0c56-47e3-8c28-78e31dc1617c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046949 Jan 11 14:16:31.858612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 294/619] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:16:31 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:16:31.861900 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b515269a-e9e3-4caf-ab75-75eeb5a0b59f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.862344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b515269a-e9e3-4caf-ab75-75eeb5a0b59f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.863282 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b515269a-e9e3-4caf-ab75-75eeb5a0b59f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:31.863762 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b515269a-e9e3-4caf-ab75-75eeb5a0b59f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:31.986616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b515269a-e9e3-4caf-ab75-75eeb5a0b59f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.136138 Jan 11 14:16:31.987461 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 326/620] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:31 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:32.141445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c36d1e28-ae61-42bc-9a5b-32ffd9e58d79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:32.142255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c36d1e28-ae61-42bc-9a5b-32ffd9e58d79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:32.149248 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c36d1e28-ae61-42bc-9a5b-32ffd9e58d79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:32.149700 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c36d1e28-ae61-42bc-9a5b-32ffd9e58d79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:32.150471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c36d1e28-ae61-42bc-9a5b-32ffd9e58d79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:32.150900 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c36d1e28-ae61-42bc-9a5b-32ffd9e58d79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:32.316039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c36d1e28-ae61-42bc-9a5b-32ffd9e58d79 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.178684 Jan 11 14:16:32.316665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 295/621] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:32 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:32.525735 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d863ef58-6015-4c40-9274-a5f1cef7f10c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:32.526429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d863ef58-6015-4c40-9274-a5f1cef7f10c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:32.533277 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d863ef58-6015-4c40-9274-a5f1cef7f10c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:32.533724 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d863ef58-6015-4c40-9274-a5f1cef7f10c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:32.534493 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d863ef58-6015-4c40-9274-a5f1cef7f10c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:32.534920 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d863ef58-6015-4c40-9274-a5f1cef7f10c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:32.669582 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d863ef58-6015-4c40-9274-a5f1cef7f10c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:32.677377 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d863ef58-6015-4c40-9274-a5f1cef7f10c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.155768 Jan 11 14:16:32.678242 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 327/622] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:32 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:32.852405 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-110f33cf-45b3-406a-8ac5-ea87c09311d3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:32.853401 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-110f33cf-45b3-406a-8ac5-ea87c09311d3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:32.860720 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-110f33cf-45b3-406a-8ac5-ea87c09311d3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:32.861173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-110f33cf-45b3-406a-8ac5-ea87c09311d3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:32.861954 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-110f33cf-45b3-406a-8ac5-ea87c09311d3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:32.862394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-110f33cf-45b3-406a-8ac5-ea87c09311d3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:32.893488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-110f33cf-45b3-406a-8ac5-ea87c09311d3 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Jan 11 14:16:32.894163 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 296/623] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:16:32 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:16:32.998654 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-74fa3f11-a360-4ec5-94de-d0c600934604 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:32.999590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-74fa3f11-a360-4ec5-94de-d0c600934604 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:33.005751 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-74fa3f11-a360-4ec5-94de-d0c600934604 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:33.006197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-74fa3f11-a360-4ec5-94de-d0c600934604 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:33.006965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-74fa3f11-a360-4ec5-94de-d0c600934604 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:33.007396 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-74fa3f11-a360-4ec5-94de-d0c600934604 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:33.070641 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-74fa3f11-a360-4ec5-94de-d0c600934604 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.076139 Jan 11 14:16:33.071279 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 328/624] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:32 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:33.329674 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7675086b-913b-4271-9994-45a0f3c64897 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:33.331142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7675086b-913b-4271-9994-45a0f3c64897 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:33.338059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7675086b-913b-4271-9994-45a0f3c64897 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:33.338516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7675086b-913b-4271-9994-45a0f3c64897 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:33.339298 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7675086b-913b-4271-9994-45a0f3c64897 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:33.339759 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7675086b-913b-4271-9994-45a0f3c64897 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:33.416780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7675086b-913b-4271-9994-45a0f3c64897 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.092720 Jan 11 14:16:33.417406 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 297/625] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:33 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:33.694492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3aedd773-fe1c-439c-91e7-0574cb702fce tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:33.695181 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3aedd773-fe1c-439c-91e7-0574cb702fce tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:33.702316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3aedd773-fe1c-439c-91e7-0574cb702fce tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:33.702762 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3aedd773-fe1c-439c-91e7-0574cb702fce tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:33.703563 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3aedd773-fe1c-439c-91e7-0574cb702fce tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:33.703995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3aedd773-fe1c-439c-91e7-0574cb702fce tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:33.830799 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3aedd773-fe1c-439c-91e7-0574cb702fce tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:33.838736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3aedd773-fe1c-439c-91e7-0574cb702fce tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.148390 Jan 11 14:16:33.839292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 329/626] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:33 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:33.906997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-195808e9-2e0b-4e20-b0c7-1ff8360446c6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:33.908039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-195808e9-2e0b-4e20-b0c7-1ff8360446c6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:33.914664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-195808e9-2e0b-4e20-b0c7-1ff8360446c6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:33.915106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-195808e9-2e0b-4e20-b0c7-1ff8360446c6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:33.915898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-195808e9-2e0b-4e20-b0c7-1ff8360446c6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:33.916326 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-195808e9-2e0b-4e20-b0c7-1ff8360446c6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:33.945357 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-195808e9-2e0b-4e20-b0c7-1ff8360446c6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042825 Jan 11 14:16:33.945823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 298/627] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:16:33 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:16:34.087456 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a0524912-9674-4e8d-8ead-ea10bf5588e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:34.088763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-472997396", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "networks": [{"uuid": "60123190-3a8f-4b75-b7ad-1e70cf2044c8"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:34.089388 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a0524912-9674-4e8d-8ead-ea10bf5588e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:34.097300 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a0524912-9674-4e8d-8ead-ea10bf5588e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.097785 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a0524912-9674-4e8d-8ead-ea10bf5588e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.098583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a0524912-9674-4e8d-8ead-ea10bf5588e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.099017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a0524912-9674-4e8d-8ead-ea10bf5588e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.151686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] validate_networks() for [('60123190-3a8f-4b75-b7ad-1e70cf2044c8', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:16:34.193013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a0524912-9674-4e8d-8ead-ea10bf5588e3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.109258 Jan 11 14:16:34.197008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 330/628] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:34 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:34.199771 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-80d4785b-0928-4d9f-95ae-393bf0455d7c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:34.200356 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-80d4785b-0928-4d9f-95ae-393bf0455d7c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:34.208142 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-80d4785b-0928-4d9f-95ae-393bf0455d7c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.208593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-80d4785b-0928-4d9f-95ae-393bf0455d7c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.209384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-80d4785b-0928-4d9f-95ae-393bf0455d7c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.209815 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-80d4785b-0928-4d9f-95ae-393bf0455d7c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.237991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-80d4785b-0928-4d9f-95ae-393bf0455d7c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:16:34.314192 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-80d4785b-0928-4d9f-95ae-393bf0455d7c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 204 len: 0 microversion: 2.1 time: 0.118663 Jan 11 14:16:34.314861 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 331/629] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:16:34 2022] DELETE /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:16:34.323067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ce66def5-b663-41d2-a439-132418a9533a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:34.324041 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ce66def5-b663-41d2-a439-132418a9533a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:34.330265 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce66def5-b663-41d2-a439-132418a9533a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.330712 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce66def5-b663-41d2-a439-132418a9533a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.331536 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce66def5-b663-41d2-a439-132418a9533a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.331967 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce66def5-b663-41d2-a439-132418a9533a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.566898 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ce66def5-b663-41d2-a439-132418a9533a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:34.574347 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ce66def5-b663-41d2-a439-132418a9533a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1507 microversion: 2.1 time: 0.255082 Jan 11 14:16:34.575108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 332/630] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:34 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:34.579256 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-22ebd0e8-c12b-4907-b4b6-35d704950931 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:34.580228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-22ebd0e8-c12b-4907-b4b6-35d704950931 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:34.585745 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22ebd0e8-c12b-4907-b4b6-35d704950931 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.586187 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22ebd0e8-c12b-4907-b4b6-35d704950931 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.586953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22ebd0e8-c12b-4907-b4b6-35d704950931 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.587384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22ebd0e8-c12b-4907-b4b6-35d704950931 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.592488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:16:34.592982 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:16:34.593538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:16:34.594056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:16:34.594537 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:16:34.603189 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.603759 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.604658 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.605168 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.622489 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Getting quotas for project b02bf5f593a54c658a76fff0246febf4. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:16:34.626381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Getting quotas for user 23f705ed82e441229edd5a48b3797b32 and project b02bf5f593a54c658a76fff0246febf4. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:16:34.636844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:16:34.639128 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:16:34.656519 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-22ebd0e8-c12b-4907-b4b6-35d704950931 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.080414 Jan 11 14:16:34.660423 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 333/631] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:34 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:34.683071 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2ce84621-8be5-47d5-a35b-de7d7a174de5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598111 Jan 11 14:16:34.683897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 299/632] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:16:34.694071 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9fa5952c-50a9-4c59-9161-682cd4130445 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:34.694770 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9fa5952c-50a9-4c59-9161-682cd4130445 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:34.748265 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9fa5952c-50a9-4c59-9161-682cd4130445 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:34.754695 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9fa5952c-50a9-4c59-9161-682cd4130445 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1217 microversion: 2.1 time: 0.064726 Jan 11 14:16:34.755441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 334/633] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:34 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:34.856176 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-bb7e562b-365b-4c75-bca5-dd8ade33d674 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:34.856794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-bb7e562b-365b-4c75-bca5-dd8ade33d674 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:34.862679 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bb7e562b-365b-4c75-bca5-dd8ade33d674 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.863128 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bb7e562b-365b-4c75-bca5-dd8ade33d674 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:34.863959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bb7e562b-365b-4c75-bca5-dd8ade33d674 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:34.864393 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bb7e562b-365b-4c75-bca5-dd8ade33d674 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.021350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-bb7e562b-365b-4c75-bca5-dd8ade33d674 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:35.031681 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-bb7e562b-365b-4c75-bca5-dd8ade33d674 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.179627 Jan 11 14:16:35.032822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 300/634] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:34 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:35.067773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-099401bd-1a84-41e2-8350-cafe9e3a670a req-d35e975e-9dec-4b2e-8f85-c8e1fe55d744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f638f3d-a3ed-4ba6-9310-81ab620fe882", "name": "network-vif-plugged", "status": "completed", "tag": "8232801e-c8a6-4b58-9700-b2811cddf236"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:35.069271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:16:35.069271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:16:35.077198 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-099401bd-1a84-41e2-8350-cafe9e3a670a req-d35e975e-9dec-4b2e-8f85-c8e1fe55d744 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.077746 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-099401bd-1a84-41e2-8350-cafe9e3a670a req-d35e975e-9dec-4b2e-8f85-c8e1fe55d744 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.089274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-099401bd-1a84-41e2-8350-cafe9e3a670a req-d35e975e-9dec-4b2e-8f85-c8e1fe55d744 service nova] Creating event network-vif-plugged:8232801e-c8a6-4b58-9700-b2811cddf236 for instance 8f638f3d-a3ed-4ba6-9310-81ab620fe882 on hv-cinder-82413 Jan 11 14:16:35.094029 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-099401bd-1a84-41e2-8350-cafe9e3a670a req-d35e975e-9dec-4b2e-8f85-c8e1fe55d744 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030217 Jan 11 14:16:35.094691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 335/635] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:16:35.206903 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9340f049-4fc5-4517-8ba3-684dcbccc76c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:35.208144 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9340f049-4fc5-4517-8ba3-684dcbccc76c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:35.216968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9340f049-4fc5-4517-8ba3-684dcbccc76c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.217571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9340f049-4fc5-4517-8ba3-684dcbccc76c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.218799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9340f049-4fc5-4517-8ba3-684dcbccc76c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.219468 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9340f049-4fc5-4517-8ba3-684dcbccc76c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.313886 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9340f049-4fc5-4517-8ba3-684dcbccc76c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.112145 Jan 11 14:16:35.315717 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 301/636] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:35 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:35.592098 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2f9e4638-1d68-4770-b14a-44013bba2d0a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:35.592708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2f9e4638-1d68-4770-b14a-44013bba2d0a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:35.598695 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f9e4638-1d68-4770-b14a-44013bba2d0a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.599145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f9e4638-1d68-4770-b14a-44013bba2d0a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.599957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f9e4638-1d68-4770-b14a-44013bba2d0a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.600418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f9e4638-1d68-4770-b14a-44013bba2d0a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.669210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-25d1e54f-8b9f-46cf-9616-02b9a3c37fb9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:35.670372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-25d1e54f-8b9f-46cf-9616-02b9a3c37fb9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:35.677115 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-25d1e54f-8b9f-46cf-9616-02b9a3c37fb9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.677582 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-25d1e54f-8b9f-46cf-9616-02b9a3c37fb9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.678348 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-25d1e54f-8b9f-46cf-9616-02b9a3c37fb9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.678781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-25d1e54f-8b9f-46cf-9616-02b9a3c37fb9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.732346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2f9e4638-1d68-4770-b14a-44013bba2d0a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:35.739717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2f9e4638-1d68-4770-b14a-44013bba2d0a tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1507 microversion: 2.1 time: 0.152221 Jan 11 14:16:35.740270 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 336/637] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:35 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:35.770658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5968e755-89c7-4ff0-a17b-518573bf862c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:35.771252 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5968e755-89c7-4ff0-a17b-518573bf862c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:35.776738 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5968e755-89c7-4ff0-a17b-518573bf862c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.777181 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5968e755-89c7-4ff0-a17b-518573bf862c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.778516 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5968e755-89c7-4ff0-a17b-518573bf862c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:35.778947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5968e755-89c7-4ff0-a17b-518573bf862c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:35.837670 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5968e755-89c7-4ff0-a17b-518573bf862c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:35.845873 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5968e755-89c7-4ff0-a17b-518573bf862c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1269 microversion: 2.1 time: 0.078241 Jan 11 14:16:35.846378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 337/638] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:35 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1269 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:36.046996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2b88c847-51d8-45c4-9f71-d5571686b91c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:36.047633 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2b88c847-51d8-45c4-9f71-d5571686b91c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:36.053760 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2b88c847-51d8-45c4-9f71-d5571686b91c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:36.054200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2b88c847-51d8-45c4-9f71-d5571686b91c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:36.054962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2b88c847-51d8-45c4-9f71-d5571686b91c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:36.055384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2b88c847-51d8-45c4-9f71-d5571686b91c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:36.184210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2b88c847-51d8-45c4-9f71-d5571686b91c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:36.191900 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2b88c847-51d8-45c4-9f71-d5571686b91c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.148368 Jan 11 14:16:36.192451 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 338/639] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:36 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:36.327304 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-379713eb-7b3d-4f84-834c-93f7b98fbbe8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:36.328231 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-379713eb-7b3d-4f84-834c-93f7b98fbbe8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:36.333908 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-379713eb-7b3d-4f84-834c-93f7b98fbbe8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:36.334349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-379713eb-7b3d-4f84-834c-93f7b98fbbe8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:36.335110 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-379713eb-7b3d-4f84-834c-93f7b98fbbe8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:36.335618 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-379713eb-7b3d-4f84-834c-93f7b98fbbe8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:40.180617 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-25d1e54f-8b9f-46cf-9616-02b9a3c37fb9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 4.515872 Jan 11 14:16:40.184469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 302/640] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:35 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 4518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:40.186107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ab317f00-b79d-409d-92a7-269c5dbb47e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:40.186787 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ab317f00-b79d-409d-92a7-269c5dbb47e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:40.194107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ab317f00-b79d-409d-92a7-269c5dbb47e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:40.194554 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ab317f00-b79d-409d-92a7-269c5dbb47e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:40.195324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ab317f00-b79d-409d-92a7-269c5dbb47e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:40.195812 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ab317f00-b79d-409d-92a7-269c5dbb47e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:40.203363 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-379713eb-7b3d-4f84-834c-93f7b98fbbe8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 3.880113 Jan 11 14:16:40.207232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 339/641] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:36 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 3882 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:40.208973 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1ec473b7-0ae8-4ef8-a2b7-6fb72b887f3a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:40.209660 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1ec473b7-0ae8-4ef8-a2b7-6fb72b887f3a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:40.217213 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1ec473b7-0ae8-4ef8-a2b7-6fb72b887f3a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:40.217740 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1ec473b7-0ae8-4ef8-a2b7-6fb72b887f3a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:40.218656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1ec473b7-0ae8-4ef8-a2b7-6fb72b887f3a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:40.219094 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1ec473b7-0ae8-4ef8-a2b7-6fb72b887f3a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:40.285714 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1ec473b7-0ae8-4ef8-a2b7-6fb72b887f3a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:40.293612 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1ec473b7-0ae8-4ef8-a2b7-6fb72b887f3a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1269 microversion: 2.1 time: 0.088312 Jan 11 14:16:40.294176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 340/642] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:40 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:40.298338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d1ecacdd-705f-4c11-b3a5-ef11b01185b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:40.298928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d1ecacdd-705f-4c11-b3a5-ef11b01185b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:40.304698 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1ecacdd-705f-4c11-b3a5-ef11b01185b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:40.305143 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1ecacdd-705f-4c11-b3a5-ef11b01185b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:40.305916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1ecacdd-705f-4c11-b3a5-ef11b01185b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:40.306345 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1ecacdd-705f-4c11-b3a5-ef11b01185b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:40.363661 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ab317f00-b79d-409d-92a7-269c5dbb47e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:40.371251 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ab317f00-b79d-409d-92a7-269c5dbb47e8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1507 microversion: 2.1 time: 0.188820 Jan 11 14:16:40.371960 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 303/643] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:40 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:40.448819 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d1ecacdd-705f-4c11-b3a5-ef11b01185b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:40.456960 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d1ecacdd-705f-4c11-b3a5-ef11b01185b3 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.161798 Jan 11 14:16:40.457575 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 341/644] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:40 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:41.192273 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-53c3f039-f5b4-41bc-b2ae-f5877052822a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:41.193186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-53c3f039-f5b4-41bc-b2ae-f5877052822a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:41.199713 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53c3f039-f5b4-41bc-b2ae-f5877052822a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.200189 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53c3f039-f5b4-41bc-b2ae-f5877052822a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.201032 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53c3f039-f5b4-41bc-b2ae-f5877052822a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.201467 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53c3f039-f5b4-41bc-b2ae-f5877052822a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.214938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ec8143e7-35c5-4f94-aace-e3e8134212e1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:41.215886 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ec8143e7-35c5-4f94-aace-e3e8134212e1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:41.223614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec8143e7-35c5-4f94-aace-e3e8134212e1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.224168 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec8143e7-35c5-4f94-aace-e3e8134212e1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.224962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec8143e7-35c5-4f94-aace-e3e8134212e1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.225397 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec8143e7-35c5-4f94-aace-e3e8134212e1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.324973 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-53c3f039-f5b4-41bc-b2ae-f5877052822a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.136216 Jan 11 14:16:41.325741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 304/645] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:41 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:41.330798 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-717f1966-00f3-4c4c-9f77-a9a57bee935c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:41.331512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-717f1966-00f3-4c4c-9f77-a9a57bee935c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:41.338252 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-717f1966-00f3-4c4c-9f77-a9a57bee935c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.338625 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-717f1966-00f3-4c4c-9f77-a9a57bee935c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.339402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-717f1966-00f3-4c4c-9f77-a9a57bee935c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.339877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-717f1966-00f3-4c4c-9f77-a9a57bee935c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.370532 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ec8143e7-35c5-4f94-aace-e3e8134212e1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.159025 Jan 11 14:16:41.371485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 342/646] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:41 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:41.388265 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fb49c3a5-b32d-4ae1-9880-71e989185245 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:41.388958 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fb49c3a5-b32d-4ae1-9880-71e989185245 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:41.397152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fb49c3a5-b32d-4ae1-9880-71e989185245 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.397602 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fb49c3a5-b32d-4ae1-9880-71e989185245 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.398384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fb49c3a5-b32d-4ae1-9880-71e989185245 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.398815 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fb49c3a5-b32d-4ae1-9880-71e989185245 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.410909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-717f1966-00f3-4c4c-9f77-a9a57bee935c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:41.418177 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-717f1966-00f3-4c4c-9f77-a9a57bee935c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1275 microversion: 2.1 time: 0.091299 Jan 11 14:16:41.419109 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 305/647] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:41 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:41.474879 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-77cc5872-5634-484b-ba81-73d71f99e664 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:41.475511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-77cc5872-5634-484b-ba81-73d71f99e664 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:41.482851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77cc5872-5634-484b-ba81-73d71f99e664 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.483306 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77cc5872-5634-484b-ba81-73d71f99e664 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.484119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77cc5872-5634-484b-ba81-73d71f99e664 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:41.484553 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77cc5872-5634-484b-ba81-73d71f99e664 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:41.688073 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fb49c3a5-b32d-4ae1-9880-71e989185245 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:41.695736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fb49c3a5-b32d-4ae1-9880-71e989185245 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1507 microversion: 2.1 time: 0.311509 Jan 11 14:16:41.696319 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 343/648] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:41 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:41.738855 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-77cc5872-5634-484b-ba81-73d71f99e664 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:41.746424 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-77cc5872-5634-484b-ba81-73d71f99e664 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1318 microversion: 2.1 time: 0.275233 Jan 11 14:16:41.747002 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 306/649] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:41 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:42.338271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c9ac8d7b-af9c-4b4f-b589-87c6ba15e4c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:42.339383 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c9ac8d7b-af9c-4b4f-b589-87c6ba15e4c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:42.346405 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c9ac8d7b-af9c-4b4f-b589-87c6ba15e4c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.346807 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c9ac8d7b-af9c-4b4f-b589-87c6ba15e4c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:42.347627 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c9ac8d7b-af9c-4b4f-b589-87c6ba15e4c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.348057 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c9ac8d7b-af9c-4b4f-b589-87c6ba15e4c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:42.392214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-384b45c3-1024-4198-8f45-13f64d4e08b0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:42.394602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-384b45c3-1024-4198-8f45-13f64d4e08b0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:42.411236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-384b45c3-1024-4198-8f45-13f64d4e08b0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.412558 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-384b45c3-1024-4198-8f45-13f64d4e08b0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:42.413961 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-384b45c3-1024-4198-8f45-13f64d4e08b0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.414708 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-384b45c3-1024-4198-8f45-13f64d4e08b0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:42.640572 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c9ac8d7b-af9c-4b4f-b589-87c6ba15e4c5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.307354 Jan 11 14:16:42.644669 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 344/650] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:42 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:42.646098 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-4e3ad6f2-3833-45d7-be15-74d0bebed1d0 req-8211c52a-0584-4b89-8158-aded07db6448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c7cf3b-e6db-481d-a653-c246c1a5559a", "tag": "fc42310a-f7c1-4855-943b-ce524357db67"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:42.647635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:16:42.647635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:16:42.650237 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-384b45c3-1024-4198-8f45-13f64d4e08b0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.270375 Jan 11 14:16:42.651026 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 307/651] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:42 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:42.655262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-4e3ad6f2-3833-45d7-be15-74d0bebed1d0 req-8211c52a-0584-4b89-8158-aded07db6448 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.655764 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-4e3ad6f2-3833-45d7-be15-74d0bebed1d0 req-8211c52a-0584-4b89-8158-aded07db6448 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:42.656482 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d5faac51-13d0-4655-a916-76403477c79c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:42.657256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d5faac51-13d0-4655-a916-76403477c79c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:42.664173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5faac51-13d0-4655-a916-76403477c79c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.664701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5faac51-13d0-4655-a916-76403477c79c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:42.665558 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5faac51-13d0-4655-a916-76403477c79c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.666090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d5faac51-13d0-4655-a916-76403477c79c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:42.667323 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-4e3ad6f2-3833-45d7-be15-74d0bebed1d0 req-8211c52a-0584-4b89-8158-aded07db6448 service nova] Creating event network-changed:fc42310a-f7c1-4855-943b-ce524357db67 for instance 15c7cf3b-e6db-481d-a653-c246c1a5559a on hv-cinder-82413 Jan 11 14:16:42.673019 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-4e3ad6f2-3833-45d7-be15-74d0bebed1d0 req-8211c52a-0584-4b89-8158-aded07db6448 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030470 Jan 11 14:16:42.675749 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 345/652] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:16:42.714582 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-071a7e95-9178-438d-97f2-51e55c636fe6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:42.715416 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-071a7e95-9178-438d-97f2-51e55c636fe6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:42.722874 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-071a7e95-9178-438d-97f2-51e55c636fe6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.723730 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-071a7e95-9178-438d-97f2-51e55c636fe6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:42.724646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-071a7e95-9178-438d-97f2-51e55c636fe6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:42.725235 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-071a7e95-9178-438d-97f2-51e55c636fe6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.215204 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d5faac51-13d0-4655-a916-76403477c79c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:43.223131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d5faac51-13d0-4655-a916-76403477c79c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.570656 Jan 11 14:16:43.223721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 308/653] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:42 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:43.228019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-285d2434-64be-4471-9245-e280b741ce2f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:43.228717 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-285d2434-64be-4471-9245-e280b741ce2f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:43.235268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-285d2434-64be-4471-9245-e280b741ce2f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:43.235753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-285d2434-64be-4471-9245-e280b741ce2f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.236539 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-285d2434-64be-4471-9245-e280b741ce2f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:43.236974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-285d2434-64be-4471-9245-e280b741ce2f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.251910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-071a7e95-9178-438d-97f2-51e55c636fe6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:43.259930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-071a7e95-9178-438d-97f2-51e55c636fe6 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1507 microversion: 2.1 time: 0.550171 Jan 11 14:16:43.260582 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 346/654] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:42 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1507 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:43.397382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-285d2434-64be-4471-9245-e280b741ce2f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:43.405175 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-285d2434-64be-4471-9245-e280b741ce2f tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1507 microversion: 2.1 time: 0.180497 Jan 11 14:16:43.405741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 309/655] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:43 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:43.421715 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d7bb0bdb-ad41-494d-86f6-a4061f15d6c8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e24c931-a1f5-46aa-84ac-5c3652d0a633", "device": "/dev/sdb"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:43.422761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d7bb0bdb-ad41-494d-86f6-a4061f15d6c8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:43.428741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d7bb0bdb-ad41-494d-86f6-a4061f15d6c8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:43.429423 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d7bb0bdb-ad41-494d-86f6-a4061f15d6c8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.430245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d7bb0bdb-ad41-494d-86f6-a4061f15d6c8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:43.430683 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d7bb0bdb-ad41-494d-86f6-a4061f15d6c8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.652373 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9b5d1d54-3104-4274-9f44-722fd0a15f8e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:43.653339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9b5d1d54-3104-4274-9f44-722fd0a15f8e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:43.659818 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9b5d1d54-3104-4274-9f44-722fd0a15f8e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:43.660278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9b5d1d54-3104-4274-9f44-722fd0a15f8e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.661068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9b5d1d54-3104-4274-9f44-722fd0a15f8e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:43.662121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9b5d1d54-3104-4274-9f44-722fd0a15f8e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.710889 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d7bb0bdb-ad41-494d-86f6-a4061f15d6c8 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "POST /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293241 Jan 11 14:16:43.715883 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 347/656] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:16:43 2022] POST /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:16:43.721989 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-aa05ad60-2b60-4b30-b86f-cecfa6c14be4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:43.723825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-aa05ad60-2b60-4b30-b86f-cecfa6c14be4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:43.730189 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aa05ad60-2b60-4b30-b86f-cecfa6c14be4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:43.730648 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aa05ad60-2b60-4b30-b86f-cecfa6c14be4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.731540 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aa05ad60-2b60-4b30-b86f-cecfa6c14be4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:43.732525 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-aa05ad60-2b60-4b30-b86f-cecfa6c14be4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:43.975767 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9b5d1d54-3104-4274-9f44-722fd0a15f8e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.326817 Jan 11 14:16:43.976824 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 310/657] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:43 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:43.987677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-aa05ad60-2b60-4b30-b86f-cecfa6c14be4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.269566 Jan 11 14:16:43.988341 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 348/658] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:43 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:44.240372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f5e2fadc-f064-4405-ae90-d5931325e500 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:44.241068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f5e2fadc-f064-4405-ae90-d5931325e500 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:44.248215 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f5e2fadc-f064-4405-ae90-d5931325e500 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:44.248669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f5e2fadc-f064-4405-ae90-d5931325e500 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:44.249597 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f5e2fadc-f064-4405-ae90-d5931325e500 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:44.250035 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f5e2fadc-f064-4405-ae90-d5931325e500 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:44.278504 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a9a5d476-d879-448f-ac9a-99ae3651881b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:44.280685 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a9a5d476-d879-448f-ac9a-99ae3651881b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:44.288430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a9a5d476-d879-448f-ac9a-99ae3651881b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:44.288876 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a9a5d476-d879-448f-ac9a-99ae3651881b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:44.289882 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a9a5d476-d879-448f-ac9a-99ae3651881b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:44.291080 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a9a5d476-d879-448f-ac9a-99ae3651881b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:44.374733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a9a5d476-d879-448f-ac9a-99ae3651881b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:44.383783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a9a5d476-d879-448f-ac9a-99ae3651881b tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 200 len: 1293 microversion: 2.1 time: 0.109507 Jan 11 14:16:44.384367 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 349/659] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:44 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:44.449511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f5e2fadc-f064-4405-ae90-d5931325e500 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:44.457691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f5e2fadc-f064-4405-ae90-d5931325e500 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.221551 Jan 11 14:16:44.458307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 311/660] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:44 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:44.690228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-ff4ed8cb-944c-4854-803e-a86d2ffb1850 req-c3033bb9-ae4e-4e9c-86e7-a472877fc061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa034417-f545-486a-9795-890931667012", "name": "network-vif-deleted", "tag": "5a970ee5-fb4e-433b-a01a-9adab15fef70"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:44.691861 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:16:44.691861 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:16:44.699312 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-ff4ed8cb-944c-4854-803e-a86d2ffb1850 req-c3033bb9-ae4e-4e9c-86e7-a472877fc061 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:44.699704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-ff4ed8cb-944c-4854-803e-a86d2ffb1850 req-c3033bb9-ae4e-4e9c-86e7-a472877fc061 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:44.710374 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-ff4ed8cb-944c-4854-803e-a86d2ffb1850 req-c3033bb9-ae4e-4e9c-86e7-a472877fc061 service nova] Creating event network-vif-deleted:5a970ee5-fb4e-433b-a01a-9adab15fef70 for instance aa034417-f545-486a-9795-890931667012 on hv-cinder-82413 Jan 11 14:16:44.714911 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-ff4ed8cb-944c-4854-803e-a86d2ffb1850 req-c3033bb9-ae4e-4e9c-86e7-a472877fc061 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028358 Jan 11 14:16:44.715481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 350/661] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:16:44.988537 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-75cdb1dd-e2d6-4333-8823-d3ca7fc45fa9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:44.988902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-75cdb1dd-e2d6-4333-8823-d3ca7fc45fa9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:44.995378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-75cdb1dd-e2d6-4333-8823-d3ca7fc45fa9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:44.995930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-75cdb1dd-e2d6-4333-8823-d3ca7fc45fa9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:44.996778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-75cdb1dd-e2d6-4333-8823-d3ca7fc45fa9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:44.997882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-75cdb1dd-e2d6-4333-8823-d3ca7fc45fa9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.000211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2cb30dda-b08c-4a0e-9496-a093e3080d94 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:45.001394 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2cb30dda-b08c-4a0e-9496-a093e3080d94 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:45.010987 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2cb30dda-b08c-4a0e-9496-a093e3080d94 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.013195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2cb30dda-b08c-4a0e-9496-a093e3080d94 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.014150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2cb30dda-b08c-4a0e-9496-a093e3080d94 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.014749 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2cb30dda-b08c-4a0e-9496-a093e3080d94 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.137459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-75cdb1dd-e2d6-4333-8823-d3ca7fc45fa9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.153098 Jan 11 14:16:45.138154 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 312/662] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:44 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:45.145886 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2cb30dda-b08c-4a0e-9496-a093e3080d94 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.150644 Jan 11 14:16:45.146518 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 351/663] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:44 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:45.401672 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:45.402280 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: aa034417-f545-486a-9795-890931667012] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:45.409680 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.410122 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.410889 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.411318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.425357 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] HTTP exception thrown: Instance aa034417-f545-486a-9795-890931667012 could not be found. Jan 11 14:16:45.425981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Returning 404 to user: Instance aa034417-f545-486a-9795-890931667012 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:16:45.426775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-61a9e6ad-cf79-4544-ba41-09bda90cef45 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012" status: 404 len: 111 microversion: 2.1 time: 0.029214 Jan 11 14:16:45.427965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 313/664] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:45 2022] GET /compute/v2.1/servers/aa034417-f545-486a-9795-890931667012 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:16:45.436855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ac47dd58-7c82-4321-8c51-7a90ac7098a5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:45.437836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ac47dd58-7c82-4321-8c51-7a90ac7098a5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:45.446893 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac47dd58-7c82-4321-8c51-7a90ac7098a5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.447461 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac47dd58-7c82-4321-8c51-7a90ac7098a5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.448835 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac47dd58-7c82-4321-8c51-7a90ac7098a5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.449384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac47dd58-7c82-4321-8c51-7a90ac7098a5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.474211 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-936fea12-100d-449c-a1fd-a8b0e22db4ae tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:45.474824 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-936fea12-100d-449c-a1fd-a8b0e22db4ae tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:45.476358 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ac47dd58-7c82-4321-8c51-7a90ac7098a5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:16:45.482674 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-936fea12-100d-449c-a1fd-a8b0e22db4ae tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.483315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-936fea12-100d-449c-a1fd-a8b0e22db4ae tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.484168 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-936fea12-100d-449c-a1fd-a8b0e22db4ae tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.484787 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-936fea12-100d-449c-a1fd-a8b0e22db4ae tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.557423 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ac47dd58-7c82-4321-8c51-7a90ac7098a5 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "DELETE /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 204 len: 0 microversion: 2.1 time: 0.124189 Jan 11 14:16:45.558040 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 352/665] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:16:45 2022] DELETE /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:16:45.566238 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-384d4d49-187a-4379-bd8e-1131a288fe1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:45.567070 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-384d4d49-187a-4379-bd8e-1131a288fe1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:45.573053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-384d4d49-187a-4379-bd8e-1131a288fe1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.573346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-384d4d49-187a-4379-bd8e-1131a288fe1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.574513 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-384d4d49-187a-4379-bd8e-1131a288fe1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:45.574827 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-384d4d49-187a-4379-bd8e-1131a288fe1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:45.657077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-936fea12-100d-449c-a1fd-a8b0e22db4ae tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:45.664243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-936fea12-100d-449c-a1fd-a8b0e22db4ae tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.193913 Jan 11 14:16:45.664790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 314/666] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:45 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:45.724014 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-384d4d49-187a-4379-bd8e-1131a288fe1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:45.731235 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-384d4d49-187a-4379-bd8e-1131a288fe1c tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.168936 Jan 11 14:16:45.731823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 353/667] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:45 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:46.148709 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-eb12b712-8aa0-49b6-b508-c3334d645f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:46.149628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-eb12b712-8aa0-49b6-b508-c3334d645f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:46.156268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb12b712-8aa0-49b6-b508-c3334d645f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:46.156721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb12b712-8aa0-49b6-b508-c3334d645f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:46.157508 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb12b712-8aa0-49b6-b508-c3334d645f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:46.157926 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-27ca68e1-e195-4cc4-88f3-c7429084a06d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:46.158097 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb12b712-8aa0-49b6-b508-c3334d645f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:46.158907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-27ca68e1-e195-4cc4-88f3-c7429084a06d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:46.165859 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27ca68e1-e195-4cc4-88f3-c7429084a06d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:46.166499 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27ca68e1-e195-4cc4-88f3-c7429084a06d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:46.167460 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27ca68e1-e195-4cc4-88f3-c7429084a06d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:46.167928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-27ca68e1-e195-4cc4-88f3-c7429084a06d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:46.253386 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-eb12b712-8aa0-49b6-b508-c3334d645f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.108130 Jan 11 14:16:46.255532 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 315/668] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:46 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:46.269549 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-27ca68e1-e195-4cc4-88f3-c7429084a06d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.115680 Jan 11 14:16:46.270225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 354/669] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:46 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:46.681102 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b8350155-ec5d-40c6-8f18-2b185ca864c0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:46.681807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b8350155-ec5d-40c6-8f18-2b185ca864c0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:46.689620 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8350155-ec5d-40c6-8f18-2b185ca864c0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:46.690074 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8350155-ec5d-40c6-8f18-2b185ca864c0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:46.690872 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8350155-ec5d-40c6-8f18-2b185ca864c0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:46.691295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8350155-ec5d-40c6-8f18-2b185ca864c0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:46.748086 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7b95ba9c-96d8-40b7-a4d7-d46191184156 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:46.748902 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7b95ba9c-96d8-40b7-a4d7-d46191184156 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:46.759735 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b95ba9c-96d8-40b7-a4d7-d46191184156 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:46.760304 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b95ba9c-96d8-40b7-a4d7-d46191184156 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:46.761297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b95ba9c-96d8-40b7-a4d7-d46191184156 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:46.762087 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b95ba9c-96d8-40b7-a4d7-d46191184156 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:46.900836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b8350155-ec5d-40c6-8f18-2b185ca864c0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:46.909141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b8350155-ec5d-40c6-8f18-2b185ca864c0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.231634 Jan 11 14:16:46.918925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 316/670] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:46 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:46.959898 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7b95ba9c-96d8-40b7-a4d7-d46191184156 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:46.967846 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7b95ba9c-96d8-40b7-a4d7-d46191184156 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.224056 Jan 11 14:16:46.968579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 355/671] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:46 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:47.264945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-de25b8ab-f3b0-4822-9148-a80642b897aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:47.265933 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-de25b8ab-f3b0-4822-9148-a80642b897aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:47.272431 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de25b8ab-f3b0-4822-9148-a80642b897aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:47.272890 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de25b8ab-f3b0-4822-9148-a80642b897aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:47.273683 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de25b8ab-f3b0-4822-9148-a80642b897aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:47.274145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de25b8ab-f3b0-4822-9148-a80642b897aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:47.282695 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bdf3075d-1e77-4680-9b81-065509b40d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:47.284159 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bdf3075d-1e77-4680-9b81-065509b40d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:47.290781 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdf3075d-1e77-4680-9b81-065509b40d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:47.291298 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdf3075d-1e77-4680-9b81-065509b40d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:47.292127 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdf3075d-1e77-4680-9b81-065509b40d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:47.292553 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdf3075d-1e77-4680-9b81-065509b40d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:47.425122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bdf3075d-1e77-4680-9b81-065509b40d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.145495 Jan 11 14:16:47.426025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 356/672] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:47 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:47.427891 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-de25b8ab-f3b0-4822-9148-a80642b897aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.166467 Jan 11 14:16:47.429540 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 317/673] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:47 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:47.926099 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-940a09c9-61bb-428c-9b81-129f3a405111 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:47.926783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-940a09c9-61bb-428c-9b81-129f3a405111 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:47.935225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-940a09c9-61bb-428c-9b81-129f3a405111 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:47.935809 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-940a09c9-61bb-428c-9b81-129f3a405111 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:47.936701 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-940a09c9-61bb-428c-9b81-129f3a405111 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:47.938770 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-940a09c9-61bb-428c-9b81-129f3a405111 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:47.985756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-aa1f59db-0abf-4de2-87b9-0157d06b6586 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:47.986461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-aa1f59db-0abf-4de2-87b9-0157d06b6586 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:47.993873 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa1f59db-0abf-4de2-87b9-0157d06b6586 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:47.994330 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa1f59db-0abf-4de2-87b9-0157d06b6586 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:47.995128 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa1f59db-0abf-4de2-87b9-0157d06b6586 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:47.995593 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa1f59db-0abf-4de2-87b9-0157d06b6586 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:48.137584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-940a09c9-61bb-428c-9b81-129f3a405111 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:48.145599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-940a09c9-61bb-428c-9b81-129f3a405111 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.223667 Jan 11 14:16:48.146732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 357/674] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:47 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:48.194285 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-aa1f59db-0abf-4de2-87b9-0157d06b6586 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:48.202466 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-aa1f59db-0abf-4de2-87b9-0157d06b6586 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.221521 Jan 11 14:16:48.203779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 318/675] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:47 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:48.437558 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a588d0c3-7efa-40c2-80cf-ef76471950cb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:48.439161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a588d0c3-7efa-40c2-80cf-ef76471950cb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:48.440750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-73c13bc6-7248-4f59-b63d-b5d9761efc69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:48.442276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-73c13bc6-7248-4f59-b63d-b5d9761efc69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:48.447330 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a588d0c3-7efa-40c2-80cf-ef76471950cb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:48.448207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a588d0c3-7efa-40c2-80cf-ef76471950cb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:48.449631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a588d0c3-7efa-40c2-80cf-ef76471950cb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:48.450225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a588d0c3-7efa-40c2-80cf-ef76471950cb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:48.451880 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-73c13bc6-7248-4f59-b63d-b5d9761efc69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:48.452441 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-73c13bc6-7248-4f59-b63d-b5d9761efc69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:48.454067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-73c13bc6-7248-4f59-b63d-b5d9761efc69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:48.454617 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-73c13bc6-7248-4f59-b63d-b5d9761efc69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:48.561585 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a588d0c3-7efa-40c2-80cf-ef76471950cb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.128574 Jan 11 14:16:48.562495 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 358/676] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:48 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:48.568259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-73c13bc6-7248-4f59-b63d-b5d9761efc69 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.132066 Jan 11 14:16:48.571530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 319/677] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:48 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:49.163352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4fa88ad3-5ec4-45a4-b8de-29836827ff62 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:49.164110 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4fa88ad3-5ec4-45a4-b8de-29836827ff62 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:49.171262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4fa88ad3-5ec4-45a4-b8de-29836827ff62 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:49.171963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4fa88ad3-5ec4-45a4-b8de-29836827ff62 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:49.172754 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4fa88ad3-5ec4-45a4-b8de-29836827ff62 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:49.173183 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4fa88ad3-5ec4-45a4-b8de-29836827ff62 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:49.221603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5c5e1bd0-929f-499d-87af-36ea5f35beac tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:49.223393 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5c5e1bd0-929f-499d-87af-36ea5f35beac tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:49.230880 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5c5e1bd0-929f-499d-87af-36ea5f35beac tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:49.231340 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5c5e1bd0-929f-499d-87af-36ea5f35beac tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:49.232200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5c5e1bd0-929f-499d-87af-36ea5f35beac tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:49.232792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5c5e1bd0-929f-499d-87af-36ea5f35beac tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:49.359916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4fa88ad3-5ec4-45a4-b8de-29836827ff62 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:49.380208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4fa88ad3-5ec4-45a4-b8de-29836827ff62 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.219208 Jan 11 14:16:49.380906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 359/678] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:49 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:49.420628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5c5e1bd0-929f-499d-87af-36ea5f35beac tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:49.427938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5c5e1bd0-929f-499d-87af-36ea5f35beac tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.210868 Jan 11 14:16:49.428506 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 320/679] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:49 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:16:49.574427 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c4e437b5-6859-4672-9bf7-340668be828c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:49.580727 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4c7504da-5c87-43e2-8efe-2f15e67541b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:49.581640 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4c7504da-5c87-43e2-8efe-2f15e67541b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:49.584768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c4e437b5-6859-4672-9bf7-340668be828c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:49.594499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4c7504da-5c87-43e2-8efe-2f15e67541b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:49.596467 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c4e437b5-6859-4672-9bf7-340668be828c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:49.596984 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4c7504da-5c87-43e2-8efe-2f15e67541b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:49.597897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4c7504da-5c87-43e2-8efe-2f15e67541b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:49.598356 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c4e437b5-6859-4672-9bf7-340668be828c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:49.598853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4c7504da-5c87-43e2-8efe-2f15e67541b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:49.599772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c4e437b5-6859-4672-9bf7-340668be828c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:49.602566 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c4e437b5-6859-4672-9bf7-340668be828c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:49.691444 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c4e437b5-6859-4672-9bf7-340668be828c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.120949 Jan 11 14:16:49.692381 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 360/680] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:49 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:49.706882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4c7504da-5c87-43e2-8efe-2f15e67541b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 28613 microversion: 2.1 time: 0.129535 Jan 11 14:16:49.707573 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 321/681] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:49 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 28613 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:16:50.398903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1ddd2a33-12c4-4bdc-81fd-6c4c9cbc0eef tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:50.399780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1ddd2a33-12c4-4bdc-81fd-6c4c9cbc0eef tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:50.407202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1ddd2a33-12c4-4bdc-81fd-6c4c9cbc0eef tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:50.407814 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1ddd2a33-12c4-4bdc-81fd-6c4c9cbc0eef tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:50.408829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1ddd2a33-12c4-4bdc-81fd-6c4c9cbc0eef tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:50.409334 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1ddd2a33-12c4-4bdc-81fd-6c4c9cbc0eef tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:50.445550 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-656a1ebe-511f-4486-9f08-2f0d7b231330 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:50.446476 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-656a1ebe-511f-4486-9f08-2f0d7b231330 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:50.453448 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-656a1ebe-511f-4486-9f08-2f0d7b231330 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:50.454114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-656a1ebe-511f-4486-9f08-2f0d7b231330 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:50.455068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-656a1ebe-511f-4486-9f08-2f0d7b231330 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:50.455688 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-656a1ebe-511f-4486-9f08-2f0d7b231330 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:50.604010 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1ddd2a33-12c4-4bdc-81fd-6c4c9cbc0eef tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:50.615081 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1ddd2a33-12c4-4bdc-81fd-6c4c9cbc0eef tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.220239 Jan 11 14:16:50.615723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 361/682] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:50 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:50.679560 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-656a1ebe-511f-4486-9f08-2f0d7b231330 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:50.708246 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2d36b560-7c33-44f9-8030-0303e91637d0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:50.709169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2d36b560-7c33-44f9-8030-0303e91637d0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:50.714794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-656a1ebe-511f-4486-9f08-2f0d7b231330 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.273780 Jan 11 14:16:50.715371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 322/683] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:50 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:50.718251 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2d36b560-7c33-44f9-8030-0303e91637d0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:50.718885 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2d36b560-7c33-44f9-8030-0303e91637d0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:50.720598 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2d36b560-7c33-44f9-8030-0303e91637d0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:50.721197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2d36b560-7c33-44f9-8030-0303e91637d0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:50.731851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c383afcd-e095-4e98-ad6c-2fbf507ab2aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:50.734574 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c383afcd-e095-4e98-ad6c-2fbf507ab2aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:50.743735 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c383afcd-e095-4e98-ad6c-2fbf507ab2aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:50.744429 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c383afcd-e095-4e98-ad6c-2fbf507ab2aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:50.745897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c383afcd-e095-4e98-ad6c-2fbf507ab2aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:50.746561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c383afcd-e095-4e98-ad6c-2fbf507ab2aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:50.800454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2d36b560-7c33-44f9-8030-0303e91637d0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 28711 microversion: 2.20 time: 0.095703 Jan 11 14:16:50.801677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 362/684] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:50 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 28711 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:50.872583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c383afcd-e095-4e98-ad6c-2fbf507ab2aa tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 29208 microversion: 2.1 time: 0.144716 Jan 11 14:16:50.873932 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 323/685] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:50 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 29208 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:51.469190 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-ca002ee6-c015-443a-a750-4717dd81aed5 req-75ffe2c1-f2e5-4043-8691-0239e1cf1704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c7cf3b-e6db-481d-a653-c246c1a5559a", "name": "network-vif-plugged", "status": "completed", "tag": "fc42310a-f7c1-4855-943b-ce524357db67"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:51.471635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:16:51.471635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:16:51.484640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-ca002ee6-c015-443a-a750-4717dd81aed5 req-75ffe2c1-f2e5-4043-8691-0239e1cf1704 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:51.485343 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-ca002ee6-c015-443a-a750-4717dd81aed5 req-75ffe2c1-f2e5-4043-8691-0239e1cf1704 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:51.514675 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-ca002ee6-c015-443a-a750-4717dd81aed5 req-75ffe2c1-f2e5-4043-8691-0239e1cf1704 service nova] Creating event network-vif-plugged:fc42310a-f7c1-4855-943b-ce524357db67 for instance 15c7cf3b-e6db-481d-a653-c246c1a5559a on hv-cinder-82413 Jan 11 14:16:51.532362 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-ca002ee6-c015-443a-a750-4717dd81aed5 req-75ffe2c1-f2e5-4043-8691-0239e1cf1704 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068524 Jan 11 14:16:51.533795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 363/686] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:16:51.632078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-34f91d6d-4abc-4a37-8294-f33341b67e6b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:51.632785 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-34f91d6d-4abc-4a37-8294-f33341b67e6b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:51.649452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34f91d6d-4abc-4a37-8294-f33341b67e6b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:51.653101 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34f91d6d-4abc-4a37-8294-f33341b67e6b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:51.654039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34f91d6d-4abc-4a37-8294-f33341b67e6b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:51.654485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-34f91d6d-4abc-4a37-8294-f33341b67e6b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:51.733680 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9da4032d-6052-46bb-ba9e-4937737ef9d8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:51.734383 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9da4032d-6052-46bb-ba9e-4937737ef9d8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:51.742752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9da4032d-6052-46bb-ba9e-4937737ef9d8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:51.743459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9da4032d-6052-46bb-ba9e-4937737ef9d8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:51.744273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9da4032d-6052-46bb-ba9e-4937737ef9d8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:51.744875 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9da4032d-6052-46bb-ba9e-4937737ef9d8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:51.968787 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-34f91d6d-4abc-4a37-8294-f33341b67e6b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:51.976583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-34f91d6d-4abc-4a37-8294-f33341b67e6b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.348473 Jan 11 14:16:51.986494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 324/687] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:51 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:51.986772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9da4032d-6052-46bb-ba9e-4937737ef9d8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:51.993074 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f8361372-ec92-4c9d-8d64-c297f8c95413 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:51.994446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f8361372-ec92-4c9d-8d64-c297f8c95413 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:51.994576 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9da4032d-6052-46bb-ba9e-4937737ef9d8 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.266158 Jan 11 14:16:51.995147 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 364/688] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:51 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:52.000070 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f219705b-2412-4fa7-b0f6-60d52dfeccfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:52.002130 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f8361372-ec92-4c9d-8d64-c297f8c95413 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:52.002822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f8361372-ec92-4c9d-8d64-c297f8c95413 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:52.003898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f8361372-ec92-4c9d-8d64-c297f8c95413 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:52.004554 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f8361372-ec92-4c9d-8d64-c297f8c95413 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:52.016545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f219705b-2412-4fa7-b0f6-60d52dfeccfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:52.023678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f219705b-2412-4fa7-b0f6-60d52dfeccfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:52.024535 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f219705b-2412-4fa7-b0f6-60d52dfeccfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:52.025492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f219705b-2412-4fa7-b0f6-60d52dfeccfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:52.026096 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f219705b-2412-4fa7-b0f6-60d52dfeccfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:57.579234 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f219705b-2412-4fa7-b0f6-60d52dfeccfb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 37512 microversion: 2.1 time: 5.582785 Jan 11 14:16:57.580501 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 365/689] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:51 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 37512 bytes in 5585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:57.585832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-237cf645-9797-40d0-af4d-9c7a7b49fc33 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:57.586498 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-237cf645-9797-40d0-af4d-9c7a7b49fc33 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:57.598512 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-237cf645-9797-40d0-af4d-9c7a7b49fc33 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:57.598933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-237cf645-9797-40d0-af4d-9c7a7b49fc33 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:57.599961 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-237cf645-9797-40d0-af4d-9c7a7b49fc33 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:57.600730 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-237cf645-9797-40d0-af4d-9c7a7b49fc33 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:57.618764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f8361372-ec92-4c9d-8d64-c297f8c95413 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 32602 microversion: 2.20 time: 5.630421 Jan 11 14:16:57.620071 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 325/690] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:51 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 32602 bytes in 5633 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:16:57.630759 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-22fcd664-3b22-43fb-a989-cd3057adca0d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:57.632203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-22fcd664-3b22-43fb-a989-cd3057adca0d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:57.644556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-22fcd664-3b22-43fb-a989-cd3057adca0d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:57.645286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-22fcd664-3b22-43fb-a989-cd3057adca0d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:57.648047 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-22fcd664-3b22-43fb-a989-cd3057adca0d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:57.650480 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-22fcd664-3b22-43fb-a989-cd3057adca0d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:58.006506 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-22fcd664-3b22-43fb-a989-cd3057adca0d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:58.013491 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-237cf645-9797-40d0-af4d-9c7a7b49fc33 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:58.026768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-237cf645-9797-40d0-af4d-9c7a7b49fc33 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.444993 Jan 11 14:16:58.030138 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-22fcd664-3b22-43fb-a989-cd3057adca0d tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1521 microversion: 2.1 time: 0.408551 Jan 11 14:16:58.031301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 326/691] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:57 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:58.043424 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 366/692] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:57 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:58.313571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-a678c6a4-c0e9-4f7a-9ea9-cc785a9e720c req-7569fd1b-be41-477a-a237-96989393ae67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdb5bf8-cc2d-4e01-ad4d-6a9647801384", "name": "network-vif-deleted", "tag": "77e99707-79d4-42da-8053-2f361200d181"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:58.315902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:16:58.315902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:16:58.324882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-a678c6a4-c0e9-4f7a-9ea9-cc785a9e720c req-7569fd1b-be41-477a-a237-96989393ae67 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:58.325629 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-a678c6a4-c0e9-4f7a-9ea9-cc785a9e720c req-7569fd1b-be41-477a-a237-96989393ae67 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:58.340070 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-a678c6a4-c0e9-4f7a-9ea9-cc785a9e720c req-7569fd1b-be41-477a-a237-96989393ae67 service nova] Creating event network-vif-deleted:77e99707-79d4-42da-8053-2f361200d181 for instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 on hv-cinder-82413 Jan 11 14:16:58.346703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-a678c6a4-c0e9-4f7a-9ea9-cc785a9e720c req-7569fd1b-be41-477a-a237-96989393ae67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040817 Jan 11 14:16:58.347890 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 327/693] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:16:58.594866 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-dce7f339-2a1f-4299-8c06-c8528ba2e478 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:58.595976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-dce7f339-2a1f-4299-8c06-c8528ba2e478 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:58.604766 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dce7f339-2a1f-4299-8c06-c8528ba2e478 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:58.605646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dce7f339-2a1f-4299-8c06-c8528ba2e478 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:58.606667 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dce7f339-2a1f-4299-8c06-c8528ba2e478 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:58.607327 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dce7f339-2a1f-4299-8c06-c8528ba2e478 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:58.632346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-616b29bb-71f8-409c-936e-947cd41dfa95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:58.635837 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-616b29bb-71f8-409c-936e-947cd41dfa95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:58.647635 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-616b29bb-71f8-409c-936e-947cd41dfa95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:58.648081 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-616b29bb-71f8-409c-936e-947cd41dfa95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:58.648867 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-616b29bb-71f8-409c-936e-947cd41dfa95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:58.651695 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-616b29bb-71f8-409c-936e-947cd41dfa95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:58.725773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-dce7f339-2a1f-4299-8c06-c8528ba2e478 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 38133 microversion: 2.1 time: 0.134396 Jan 11 14:16:58.727355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 367/694] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:58 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 38133 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:16:58.755969 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-616b29bb-71f8-409c-936e-947cd41dfa95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 33451 microversion: 2.20 time: 0.127810 Jan 11 14:16:58.757142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 328/695] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:58 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 33451 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:16:59.052753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:59.053795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:59.072812 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2f597e9a-e823-43fb-a337-16d2fd53e8cd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:16:59.074060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2f597e9a-e823-43fb-a337-16d2fd53e8cd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:59.080860 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.081324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:59.082138 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.082582 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:59.094893 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f597e9a-e823-43fb-a337-16d2fd53e8cd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.096933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f597e9a-e823-43fb-a337-16d2fd53e8cd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:59.099875 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f597e9a-e823-43fb-a337-16d2fd53e8cd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.100705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f597e9a-e823-43fb-a337-16d2fd53e8cd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:59.217293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.217917 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:59.219982 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lazy-loading 'fault' on Instance uuid efdb5bf8-cc2d-4e01-ad4d-6a9647801384 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:16:59.330545 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c667ca8d78ed4288a36745cde5436283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8a41f764014f4d95c74c7348ca537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:59.338799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ad59606d-645c-4753-a3b0-e89ca4cd8465 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 200 len: 1311 microversion: 2.1 time: 0.291669 Jan 11 14:16:59.348400 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 329/696] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:59 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 1311 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:59.441459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2f597e9a-e823-43fb-a337-16d2fd53e8cd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:16:59.452273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2f597e9a-e823-43fb-a337-16d2fd53e8cd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1317 microversion: 2.1 time: 0.406102 Jan 11 14:16:59.453382 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 368/697] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:16:59 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:16:59.739892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5287c755-4ad6-4620-994a-e77dcc941af8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:59.741958 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5287c755-4ad6-4620-994a-e77dcc941af8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:59.751392 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5287c755-4ad6-4620-994a-e77dcc941af8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.752008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5287c755-4ad6-4620-994a-e77dcc941af8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:59.753075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5287c755-4ad6-4620-994a-e77dcc941af8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.753722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5287c755-4ad6-4620-994a-e77dcc941af8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:59.770681 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0710f505-c35a-4508-badc-1ebd29d0a93e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:16:59.771829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0710f505-c35a-4508-badc-1ebd29d0a93e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:16:59.783903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0710f505-c35a-4508-badc-1ebd29d0a93e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.784361 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0710f505-c35a-4508-badc-1ebd29d0a93e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:16:59.785196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0710f505-c35a-4508-badc-1ebd29d0a93e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:16:59.785634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0710f505-c35a-4508-badc-1ebd29d0a93e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:04.300579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5287c755-4ad6-4620-994a-e77dcc941af8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 38133 microversion: 2.1 time: 4.564931 Jan 11 14:17:04.306764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 330/698] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:16:59 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 38133 bytes in 4567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:17:04.309199 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:04.310025 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] [instance: efdb5bf8-cc2d-4e01-ad4d-6a9647801384] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:04.317219 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:04.317901 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:04.318844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:04.319429 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:04.336458 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0710f505-c35a-4508-badc-1ebd29d0a93e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 38175 microversion: 2.20 time: 4.570128 Jan 11 14:17:04.338154 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] HTTP exception thrown: Instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 could not be found. Jan 11 14:17:04.338925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] Returning 404 to user: Instance efdb5bf8-cc2d-4e01-ad4d-6a9647801384 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:17:04.339990 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-28d52e92-c6a4-439b-a747-c9563b3044a1 tempest-ServerRescueNegativeTestJSON-1284338907 tempest-ServerRescueNegativeTestJSON-1284338907-project] 10.222.0.49 "GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384" status: 404 len: 111 microversion: 2.1 time: 0.037399 Jan 11 14:17:04.343631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 369/699] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:16:59 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 38175 bytes in 4578 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:17:04.346285 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 331/700] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:04 2022] GET /compute/v2.1/servers/efdb5bf8-cc2d-4e01-ad4d-6a9647801384 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:17:04.351585 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a99dd79b-bd5b-4529-9f1a-9902ab737071 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:04.352293 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a99dd79b-bd5b-4529-9f1a-9902ab737071 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:04.370820 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a99dd79b-bd5b-4529-9f1a-9902ab737071 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:04.371273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a99dd79b-bd5b-4529-9f1a-9902ab737071 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:04.372137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a99dd79b-bd5b-4529-9f1a-9902ab737071 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:04.372575 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a99dd79b-bd5b-4529-9f1a-9902ab737071 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:04.716082 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a99dd79b-bd5b-4529-9f1a-9902ab737071 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:04.724186 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a99dd79b-bd5b-4529-9f1a-9902ab737071 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1507 microversion: 2.1 time: 0.378999 Jan 11 14:17:04.737424 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 370/701] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:04 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:05.312709 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4473ebca-e64f-4abc-b909-571a2681beec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:05.315163 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4473ebca-e64f-4abc-b909-571a2681beec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:05.324539 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4473ebca-e64f-4abc-b909-571a2681beec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:05.325271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4473ebca-e64f-4abc-b909-571a2681beec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:05.326865 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4473ebca-e64f-4abc-b909-571a2681beec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:05.327542 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4473ebca-e64f-4abc-b909-571a2681beec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:05.349636 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4e3e2f92-561b-4326-8c8d-5dfcd5ecf2ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:05.350989 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4e3e2f92-561b-4326-8c8d-5dfcd5ecf2ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:05.365432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4e3e2f92-561b-4326-8c8d-5dfcd5ecf2ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:05.366442 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4e3e2f92-561b-4326-8c8d-5dfcd5ecf2ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:05.370450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4e3e2f92-561b-4326-8c8d-5dfcd5ecf2ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:05.371173 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4e3e2f92-561b-4326-8c8d-5dfcd5ecf2ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:05.420717 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4473ebca-e64f-4abc-b909-571a2681beec tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 38133 microversion: 2.1 time: 0.111772 Jan 11 14:17:05.421362 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 332/702] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:17:05 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 38133 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:17:05.462122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4e3e2f92-561b-4326-8c8d-5dfcd5ecf2ff tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 38245 microversion: 2.20 time: 0.116030 Jan 11 14:17:05.463045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 371/703] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:17:05 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 38245 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:17:06.157127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-72923b31-c441-4dec-afb8-a18ac339ef31 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19548d0a-d78c-4dd1-9e43-6f39b1266102"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:06.159398 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-72923b31-c441-4dec-afb8-a18ac339ef31 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:06.180063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72923b31-c441-4dec-afb8-a18ac339ef31 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:06.181224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72923b31-c441-4dec-afb8-a18ac339ef31 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:06.182359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72923b31-c441-4dec-afb8-a18ac339ef31 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:06.183012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72923b31-c441-4dec-afb8-a18ac339ef31 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:06.440365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d993dcef-f844-4511-9bbb-c9626da053f4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:06.442475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d993dcef-f844-4511-9bbb-c9626da053f4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:06.458062 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d993dcef-f844-4511-9bbb-c9626da053f4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:06.463159 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d993dcef-f844-4511-9bbb-c9626da053f4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:06.465130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d993dcef-f844-4511-9bbb-c9626da053f4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:06.466534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d993dcef-f844-4511-9bbb-c9626da053f4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:06.629231 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-72923b31-c441-4dec-afb8-a18ac339ef31 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "POST /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478060 Jan 11 14:17:06.654062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 333/704] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:17:06 2022] POST /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:06.654625 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d993dcef-f844-4511-9bbb-c9626da053f4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 38205 microversion: 2.1 time: 0.203302 Jan 11 14:17:06.654625 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 372/705] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:17:06 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 38205 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:17:06.654811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c53e000c-d4e0-45d5-8092-1692052e206c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:06.654811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c53e000c-d4e0-45d5-8092-1692052e206c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:06.654811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c53e000c-d4e0-45d5-8092-1692052e206c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:06.654811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c53e000c-d4e0-45d5-8092-1692052e206c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:06.656045 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c53e000c-d4e0-45d5-8092-1692052e206c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:06.657935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c53e000c-d4e0-45d5-8092-1692052e206c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:06.730586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c53e000c-d4e0-45d5-8092-1692052e206c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 38245 microversion: 2.20 time: 0.095171 Jan 11 14:17:06.732373 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 334/706] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:17:06 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 38245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:17:07.283751 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d6e0b52f-ef6c-41f7-a173-28e348191ffe tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Action: 'create', calling method: .version_select at 0x7fba91bc7b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-820440232"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:07.306042 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-d6e0b52f-ef6c-41f7-a173-28e348191ffe tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Getting quotas for project 1d7f551824974a53a1ea507b061f4c72. Resources: {'key_pairs'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:17:07.310140 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-d6e0b52f-ef6c-41f7-a173-28e348191ffe tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Getting quotas for user a441db140744442fa79e31985ade6cb7 and project 1d7f551824974a53a1ea507b061f4c72. Resources: {'key_pairs'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:17:07.482141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-d6e0b52f-ef6c-41f7-a173-28e348191ffe tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Getting quotas for project 1d7f551824974a53a1ea507b061f4c72. Resources: {'key_pairs'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:17:07.486293 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-d6e0b52f-ef6c-41f7-a173-28e348191ffe tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Getting quotas for user a441db140744442fa79e31985ade6cb7 and project 1d7f551824974a53a1ea507b061f4c72. Resources: {'key_pairs'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:17:07.499780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d6e0b52f-ef6c-41f7-a173-28e348191ffe tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.220406 Jan 11 14:17:07.510412 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 373/707] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Jan 11 14:17:07 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:07.552065 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1531301935", "imageRef": "bf2993a0-3acc-4ad6-b4e7-7421e605a696", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-820440232", "networks": [{"uuid": "72a2248c-a73f-49e5-a11c-e9eb238083f0"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:07.610256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] validate_networks() for [('72a2248c-a73f-49e5-a11c-e9eb238083f0', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:17:07.659139 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d2080f5d-7514-4b01-97ff-9e198c19c6c7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:07.660808 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d2080f5d-7514-4b01-97ff-9e198c19c6c7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:07.668327 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2080f5d-7514-4b01-97ff-9e198c19c6c7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:07.669619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2080f5d-7514-4b01-97ff-9e198c19c6c7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:07.670704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2080f5d-7514-4b01-97ff-9e198c19c6c7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:07.671141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2080f5d-7514-4b01-97ff-9e198c19c6c7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:07.776018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d2080f5d-7514-4b01-97ff-9e198c19c6c7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 200 len: 38263 microversion: 2.1 time: 0.120824 Jan 11 14:17:07.777560 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 374/708] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:17:07 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 38263 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:17:07.784701 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b8098886-6ccd-4c88-8845-890aaf2c7848 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:07.785745 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b8098886-6ccd-4c88-8845-890aaf2c7848 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:07.792677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b8098886-6ccd-4c88-8845-890aaf2c7848 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:07.793131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b8098886-6ccd-4c88-8845-890aaf2c7848 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:07.794515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b8098886-6ccd-4c88-8845-890aaf2c7848 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:07.794957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b8098886-6ccd-4c88-8845-890aaf2c7848 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:07.862155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b8098886-6ccd-4c88-8845-890aaf2c7848 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 38245 microversion: 2.20 time: 0.082842 Jan 11 14:17:07.862813 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 375/709] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:17:07 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 38245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:17:07.868100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a2ce9fc0-ab00-4f02-8aff-35c45bfc54ab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:07.868703 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a2ce9fc0-ab00-4f02-8aff-35c45bfc54ab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:07.875616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a2ce9fc0-ab00-4f02-8aff-35c45bfc54ab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:07.876321 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a2ce9fc0-ab00-4f02-8aff-35c45bfc54ab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:07.877111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a2ce9fc0-ab00-4f02-8aff-35c45bfc54ab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:07.877717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a2ce9fc0-ab00-4f02-8aff-35c45bfc54ab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:07.903448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a2ce9fc0-ab00-4f02-8aff-35c45bfc54ab tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/ips" status: 200 len: 146 microversion: 2.1 time: 0.039105 Jan 11 14:17:07.904392 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 376/710] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Jan 11 14:17:07 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:08.048669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:17:08.049141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:17:08.049544 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:17:08.049991 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:17:08.050387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:17:08.064237 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:08.064693 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:08.065496 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:08.065930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:08.085412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Getting quotas for project 1d7f551824974a53a1ea507b061f4c72. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:17:08.091265 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Getting quotas for user a441db140744442fa79e31985ade6cb7 and project 1d7f551824974a53a1ea507b061f4c72. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:17:08.108183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:17:08.108605 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf2993a0-3acc-4ad6-b4e7-7421e605a696',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:17:08.154533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9a61f78a-3fbe-494d-8bc4-f4ff67bf8ee5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606603 Jan 11 14:17:08.155177 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 335/711] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:17:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:17:08.164780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-17e8b35a-e04b-4b78-aa90-dc4882779788 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:08.165395 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-17e8b35a-e04b-4b78-aa90-dc4882779788 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:08.221855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-17e8b35a-e04b-4b78-aa90-dc4882779788 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:08.228763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-17e8b35a-e04b-4b78-aa90-dc4882779788 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1258 microversion: 2.1 time: 0.067854 Jan 11 14:17:08.229712 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 377/712] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:08 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:08.875288 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-47b28bbe-38b3-4652-8522-91f313ac232f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:08.876263 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-47b28bbe-38b3-4652-8522-91f313ac232f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:08.882718 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-47b28bbe-38b3-4652-8522-91f313ac232f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:08.883164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-47b28bbe-38b3-4652-8522-91f313ac232f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:08.884108 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-47b28bbe-38b3-4652-8522-91f313ac232f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:08.884541 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-47b28bbe-38b3-4652-8522-91f313ac232f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:08.977786 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-47b28bbe-38b3-4652-8522-91f313ac232f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 200 len: 38384 microversion: 2.20 time: 0.106439 Jan 11 14:17:08.978707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 336/713] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:17:08 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 38384 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:17:08.988728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f5d0892f-d84e-494f-a4fe-323c8de8a0c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:08.989270 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f5d0892f-d84e-494f-a4fe-323c8de8a0c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:08.996441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5d0892f-d84e-494f-a4fe-323c8de8a0c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:08.997129 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5d0892f-d84e-494f-a4fe-323c8de8a0c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:08.997921 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5d0892f-d84e-494f-a4fe-323c8de8a0c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:08.998355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5d0892f-d84e-494f-a4fe-323c8de8a0c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:09.021800 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f5d0892f-d84e-494f-a4fe-323c8de8a0c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/ips" status: 200 len: 150 microversion: 2.20 time: 0.036864 Jan 11 14:17:09.022379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 378/714] 10.222.0.49 () {60 vars in 1288 bytes} [Tue Jan 11 14:17:08 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:17:09.247925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c583bfa2-3df3-4861-a75e-3f500f109c4d tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:09.248832 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c583bfa2-3df3-4861-a75e-3f500f109c4d tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:09.259640 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c583bfa2-3df3-4861-a75e-3f500f109c4d tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:09.262335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c583bfa2-3df3-4861-a75e-3f500f109c4d tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:09.263693 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c583bfa2-3df3-4861-a75e-3f500f109c4d tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:09.265183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c583bfa2-3df3-4861-a75e-3f500f109c4d tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:09.419800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c583bfa2-3df3-4861-a75e-3f500f109c4d tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:09.429712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c583bfa2-3df3-4861-a75e-3f500f109c4d tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1318 microversion: 2.1 time: 0.187252 Jan 11 14:17:09.430971 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 337/715] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:09 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:09.563689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d2bb278f-f43f-4650-9b9a-7c6f4bb1d472 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:09.564212 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d2bb278f-f43f-4650-9b9a-7c6f4bb1d472 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:09.575956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2bb278f-f43f-4650-9b9a-7c6f4bb1d472 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:09.576420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2bb278f-f43f-4650-9b9a-7c6f4bb1d472 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:09.577222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2bb278f-f43f-4650-9b9a-7c6f4bb1d472 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:09.577659 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2bb278f-f43f-4650-9b9a-7c6f4bb1d472 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:09.708226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-d2bb278f-f43f-4650-9b9a-7c6f4bb1d472 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lazy-loading 'services' on Instance uuid 8f638f3d-a3ed-4ba6-9310-81ab620fe882 {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:17:09.799160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d2bb278f-f43f-4650-9b9a-7c6f4bb1d472 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882/os-volume_attachments/0e24c931-a1f5-46aa-84ac-5c3652d0a633" status: 202 len: 0 microversion: 2.1 time: 0.241569 Jan 11 14:17:09.811026 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 379/716] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:17:09 2022] DELETE /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882/os-volume_attachments/0e24c931-a1f5-46aa-84ac-5c3652d0a633 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:17:10.447047 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-512e99d6-0355-4acb-bec1-018f3a185f9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:10.448235 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-512e99d6-0355-4acb-bec1-018f3a185f9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:10.459759 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-512e99d6-0355-4acb-bec1-018f3a185f9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:10.464216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-512e99d6-0355-4acb-bec1-018f3a185f9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:10.465455 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-512e99d6-0355-4acb-bec1-018f3a185f9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:10.467148 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-512e99d6-0355-4acb-bec1-018f3a185f9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:10.677590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-512e99d6-0355-4acb-bec1-018f3a185f9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:10.686692 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-512e99d6-0355-4acb-bec1-018f3a185f9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.243140 Jan 11 14:17:10.687868 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 338/717] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:10 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:11.400001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d699ece8-7aaa-4951-9698-85e4316a802b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:11.400700 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d699ece8-7aaa-4951-9698-85e4316a802b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:11.407182 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d699ece8-7aaa-4951-9698-85e4316a802b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:11.407669 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d699ece8-7aaa-4951-9698-85e4316a802b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:11.408457 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d699ece8-7aaa-4951-9698-85e4316a802b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:11.408895 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d699ece8-7aaa-4951-9698-85e4316a802b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:11.431844 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-d699ece8-7aaa-4951-9698-85e4316a802b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lazy-loading 'flavor' on Instance uuid 07361687-ec7a-4f6e-8e42-530c1a64ba04 {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:17:11.709422 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-15f27b56-b6da-47d6-a498-2d000a67437e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:11.711048 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-15f27b56-b6da-47d6-a498-2d000a67437e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:11.721039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-15f27b56-b6da-47d6-a498-2d000a67437e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:11.722304 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-15f27b56-b6da-47d6-a498-2d000a67437e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:11.723617 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-15f27b56-b6da-47d6-a498-2d000a67437e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:11.724259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-15f27b56-b6da-47d6-a498-2d000a67437e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:11.756009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d699ece8-7aaa-4951-9698-85e4316a802b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 202 len: 0 microversion: 2.20 time: 0.360250 Jan 11 14:17:11.756790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 380/718] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:17:11 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:17:11.765783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fcb38586-957b-4437-a8e8-f524e98d1085 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cab185c-2097-4f31-9088-a93eb0fab169"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:11.767059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fcb38586-957b-4437-a8e8-f524e98d1085 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:11.774528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fcb38586-957b-4437-a8e8-f524e98d1085 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:11.774980 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fcb38586-957b-4437-a8e8-f524e98d1085 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:11.775816 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fcb38586-957b-4437-a8e8-f524e98d1085 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:11.776256 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fcb38586-957b-4437-a8e8-f524e98d1085 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:11.931156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-15f27b56-b6da-47d6-a498-2d000a67437e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:11.943193 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-15f27b56-b6da-47d6-a498-2d000a67437e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.239386 Jan 11 14:17:11.943993 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 339/719] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:11 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:11.949153 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:11.951288 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:11.978788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:11.979405 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:11.981419 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:11.982086 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:12.155969 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:12.163995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:12.166530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:12.167874 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1bf8ea54-35b6-4d77-b24e-0136ad1b1660 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.222673 Jan 11 14:17:12.172090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 340/720] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:11 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:12.961716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3aa8ed24-b465-458b-9b0d-57fb1e858fb5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:12.962339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3aa8ed24-b465-458b-9b0d-57fb1e858fb5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:12.969027 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aa8ed24-b465-458b-9b0d-57fb1e858fb5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:12.969476 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aa8ed24-b465-458b-9b0d-57fb1e858fb5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:12.970251 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aa8ed24-b465-458b-9b0d-57fb1e858fb5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:12.970685 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aa8ed24-b465-458b-9b0d-57fb1e858fb5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:13.143608 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3aa8ed24-b465-458b-9b0d-57fb1e858fb5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:13.145646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3aa8ed24-b465-458b-9b0d-57fb1e858fb5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.187417 Jan 11 14:17:13.146408 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 341/721] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:12 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:13.185793 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:13.186438 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:13.193494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:13.193947 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:13.194795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:13.195240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:13.331471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:13.339520 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:13.341333 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:13.342504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2b5b6b1f-a60e-4224-8d8b-7fc4be2df2af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.160534 Jan 11 14:17:13.354360 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 342/722] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:13 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:14.162576 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5e8edd99-db40-46e4-b7fe-0e5a78f36ca7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:14.163442 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5e8edd99-db40-46e4-b7fe-0e5a78f36ca7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:14.170401 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e8edd99-db40-46e4-b7fe-0e5a78f36ca7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:14.171103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e8edd99-db40-46e4-b7fe-0e5a78f36ca7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:14.171946 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e8edd99-db40-46e4-b7fe-0e5a78f36ca7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:14.172446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e8edd99-db40-46e4-b7fe-0e5a78f36ca7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:14.319452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5e8edd99-db40-46e4-b7fe-0e5a78f36ca7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:14.329053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5e8edd99-db40-46e4-b7fe-0e5a78f36ca7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.170563 Jan 11 14:17:14.329650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 343/723] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:14 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:14.362682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:14.363286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:14.370718 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:14.371172 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:14.372835 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:14.373462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:14.538137 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:14.550367 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:14.552082 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:14.553703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dc7fba57-167e-4966-83c4-6737485a540c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.196532 Jan 11 14:17:14.555107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 344/724] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:14 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:15.345896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-51e112ed-1b99-4fcd-83c8-db1351e1a172 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:15.346609 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-51e112ed-1b99-4fcd-83c8-db1351e1a172 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:15.354417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-51e112ed-1b99-4fcd-83c8-db1351e1a172 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:15.354417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-51e112ed-1b99-4fcd-83c8-db1351e1a172 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:15.354794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-51e112ed-1b99-4fcd-83c8-db1351e1a172 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:15.355319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-51e112ed-1b99-4fcd-83c8-db1351e1a172 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:15.504258 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-51e112ed-1b99-4fcd-83c8-db1351e1a172 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:15.513325 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-51e112ed-1b99-4fcd-83c8-db1351e1a172 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.170119 Jan 11 14:17:15.523167 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 345/725] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:15 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:15.575406 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:15.576322 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:15.584146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:15.584858 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:15.585776 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:15.586319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:15.747803 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:15.756093 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:15.757650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:15.759010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dcc3854f-6e20-4910-8996-8a69a5c321bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.188619 Jan 11 14:17:15.759600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 346/726] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:15 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:16.530505 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8c4361f6-e16d-4e42-910c-9670c59dae69 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:16.531263 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8c4361f6-e16d-4e42-910c-9670c59dae69 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:16.537512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c4361f6-e16d-4e42-910c-9670c59dae69 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:16.537954 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c4361f6-e16d-4e42-910c-9670c59dae69 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:16.538763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c4361f6-e16d-4e42-910c-9670c59dae69 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:16.539193 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c4361f6-e16d-4e42-910c-9670c59dae69 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:16.709125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8c4361f6-e16d-4e42-910c-9670c59dae69 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:16.726120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8c4361f6-e16d-4e42-910c-9670c59dae69 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.199745 Jan 11 14:17:16.739666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 347/727] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:16 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:16.779165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:16.780196 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:16.786452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:16.787197 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:16.788265 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:16.788778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:16.964258 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:16.973888 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:16.975611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:16.976675 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-81133ef2-9021-4c36-b8f1-38bb19e7bc86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.202718 Jan 11 14:17:16.977223 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 348/728] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:16 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:17.743414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-05603302-dd99-4d93-a562-953bbb28330f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:17.744090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-05603302-dd99-4d93-a562-953bbb28330f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:17.752026 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-05603302-dd99-4d93-a562-953bbb28330f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:17.752659 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-05603302-dd99-4d93-a562-953bbb28330f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:17.753689 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-05603302-dd99-4d93-a562-953bbb28330f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:17.754233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-05603302-dd99-4d93-a562-953bbb28330f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:17.903371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-05603302-dd99-4d93-a562-953bbb28330f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:17.915638 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-05603302-dd99-4d93-a562-953bbb28330f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.176438 Jan 11 14:17:17.916865 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 349/729] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:17 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:17.997884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:17.998611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:18.004493 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:18.005145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:18.005987 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:18.006451 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:18.161950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:18.170435 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:18.172007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:18.173208 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fe1d89a1-b71b-4670-b3a8-f599123fea2b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.179819 Jan 11 14:17:18.177113 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 350/730] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:17 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:18.933538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8c11de95-39fc-400e-b575-dfb12db1a3a7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:18.934538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8c11de95-39fc-400e-b575-dfb12db1a3a7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:18.940935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c11de95-39fc-400e-b575-dfb12db1a3a7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:18.941394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c11de95-39fc-400e-b575-dfb12db1a3a7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:18.942192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c11de95-39fc-400e-b575-dfb12db1a3a7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:18.942665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c11de95-39fc-400e-b575-dfb12db1a3a7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:19.076440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8c11de95-39fc-400e-b575-dfb12db1a3a7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:19.083843 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8c11de95-39fc-400e-b575-dfb12db1a3a7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.154110 Jan 11 14:17:19.084419 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 351/731] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:18 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:19.194831 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:19.195335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:19.201972 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:19.202430 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:19.203212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:19.203691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:19.337447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:19.346255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:19.349946 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:19.349946 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-91a7810b-f55e-44bc-9881-d2b8f5763bf2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.157970 Jan 11 14:17:19.349946 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 352/732] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:19 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:20.101183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1b259ba3-9dd0-4474-b75b-850d641d2f98 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:20.101921 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1b259ba3-9dd0-4474-b75b-850d641d2f98 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:20.108103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b259ba3-9dd0-4474-b75b-850d641d2f98 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:20.108550 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b259ba3-9dd0-4474-b75b-850d641d2f98 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:20.109327 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b259ba3-9dd0-4474-b75b-850d641d2f98 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:20.109758 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b259ba3-9dd0-4474-b75b-850d641d2f98 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:20.245156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1b259ba3-9dd0-4474-b75b-850d641d2f98 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:20.252697 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1b259ba3-9dd0-4474-b75b-850d641d2f98 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.155156 Jan 11 14:17:20.253264 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 353/733] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:20 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:20.367586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:20.368045 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:20.374451 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:20.374895 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:20.375774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:20.376308 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:20.509610 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:20.518089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:20.519659 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:20.520829 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8619fe00-0b7d-4ca6-b3f0-4f4fd5fb6d7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.157133 Jan 11 14:17:20.521388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 354/734] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:20 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:21.272971 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-72b5744b-f314-4bba-bacb-f4f9f56dbec0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:21.274824 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-72b5744b-f314-4bba-bacb-f4f9f56dbec0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:21.282499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72b5744b-f314-4bba-bacb-f4f9f56dbec0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:21.283209 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72b5744b-f314-4bba-bacb-f4f9f56dbec0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:21.284042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72b5744b-f314-4bba-bacb-f4f9f56dbec0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:21.284794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72b5744b-f314-4bba-bacb-f4f9f56dbec0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:21.447412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-72b5744b-f314-4bba-bacb-f4f9f56dbec0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:21.455871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-72b5744b-f314-4bba-bacb-f4f9f56dbec0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.188941 Jan 11 14:17:21.457684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 355/735] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:21 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:21.537909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:21.538634 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:21.555842 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:21.556375 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:21.557275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:21.557899 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:21.755372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:21.763806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:21.765334 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:21.766633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fc537aa1-ce29-46b3-a653-f547e22256ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.232298 Jan 11 14:17:21.767236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 356/736] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:21 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:22.474512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f64a21f9-580e-4a35-860e-5549fe254f28 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:22.475148 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f64a21f9-580e-4a35-860e-5549fe254f28 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:22.482340 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f64a21f9-580e-4a35-860e-5549fe254f28 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:22.483030 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f64a21f9-580e-4a35-860e-5549fe254f28 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:22.484020 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f64a21f9-580e-4a35-860e-5549fe254f28 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:22.484612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f64a21f9-580e-4a35-860e-5549fe254f28 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:22.628479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f64a21f9-580e-4a35-860e-5549fe254f28 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:22.635867 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f64a21f9-580e-4a35-860e-5549fe254f28 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.166333 Jan 11 14:17:22.639724 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 357/737] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:22 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:22.786747 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:22.787461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:22.793660 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:22.794469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:22.795513 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:22.795977 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:22.940779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:22.951743 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:22.953159 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:22.954314 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6b38905c-876e-4cac-bb69-74d88ada2341 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.171703 Jan 11 14:17:22.954862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 358/738] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:22 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:23.657176 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-18b2968e-07fa-44f8-ab46-7341d17e789e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:23.657866 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-18b2968e-07fa-44f8-ab46-7341d17e789e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:23.664300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-18b2968e-07fa-44f8-ab46-7341d17e789e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:23.664749 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-18b2968e-07fa-44f8-ab46-7341d17e789e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:23.665533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-18b2968e-07fa-44f8-ab46-7341d17e789e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:23.665970 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-18b2968e-07fa-44f8-ab46-7341d17e789e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:23.838094 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-18b2968e-07fa-44f8-ab46-7341d17e789e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:23.846396 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-18b2968e-07fa-44f8-ab46-7341d17e789e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.192780 Jan 11 14:17:23.847056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 359/739] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:23 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:23.972435 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:23.973116 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:23.978974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:23.979426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:23.980261 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:23.981431 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:24.113552 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:24.121291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:24.122818 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:24.124004 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5d7d56b2-f8b7-4fad-a976-5a16c134f0bc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.155279 Jan 11 14:17:24.124564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 360/740] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:23 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:24.863628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-823173eb-a008-48a6-b1bb-66b5f334293c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:24.864224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-823173eb-a008-48a6-b1bb-66b5f334293c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:24.870395 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-823173eb-a008-48a6-b1bb-66b5f334293c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:24.870847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-823173eb-a008-48a6-b1bb-66b5f334293c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:24.872165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-823173eb-a008-48a6-b1bb-66b5f334293c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:24.872604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-823173eb-a008-48a6-b1bb-66b5f334293c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:25.001920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-823173eb-a008-48a6-b1bb-66b5f334293c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:25.009249 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-823173eb-a008-48a6-b1bb-66b5f334293c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.149343 Jan 11 14:17:25.009823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 361/741] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:24 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:25.142475 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:25.143082 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:25.149101 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:25.149547 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:25.150322 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:25.150754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:25.280654 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:25.288602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:25.290121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:25.291277 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-53b9028b-5324-40fa-beeb-fd418030a833 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.152939 Jan 11 14:17:25.291864 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 362/742] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:25 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:26.025655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-13c376c7-00a8-4e4c-8410-363719e00ae7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:26.028678 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-13c376c7-00a8-4e4c-8410-363719e00ae7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:26.035047 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-13c376c7-00a8-4e4c-8410-363719e00ae7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:26.035606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-13c376c7-00a8-4e4c-8410-363719e00ae7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:26.036647 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-13c376c7-00a8-4e4c-8410-363719e00ae7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:26.037155 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-13c376c7-00a8-4e4c-8410-363719e00ae7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:26.127099 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fcb38586-957b-4437-a8e8-f524e98d1085 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.368845 Jan 11 14:17:26.127910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 381/743] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:17:11 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/os-volume_attachments => generated 194 bytes in 14370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:26.288782 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-13c376c7-00a8-4e4c-8410-363719e00ae7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:26.297256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-13c376c7-00a8-4e4c-8410-363719e00ae7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.275314 Jan 11 14:17:26.297827 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 363/744] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:26 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:26.312380 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:26.313459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:26.319877 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:26.321091 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:26.322052 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:26.322795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:26.575464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:26.584410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:26.585933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:26.587357 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b715c76b-650b-47e5-9032-ff9b7f6ed277 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.280752 Jan 11 14:17:26.587679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 382/745] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:26 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:26.780352 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-324ec5ab-6514-425a-adf0-6e3315418004 req-10349e62-07d3-4549-a068-16f9cfafbc4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682faefe-6922-4f9f-b5b8-48b8c9a49665", "tag": "c7e7af63-dba4-40f2-b97e-3dc8a5d14124"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:26.782156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:17:26.782156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:17:26.795250 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-324ec5ab-6514-425a-adf0-6e3315418004 req-10349e62-07d3-4549-a068-16f9cfafbc4b service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:26.795817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-324ec5ab-6514-425a-adf0-6e3315418004 req-10349e62-07d3-4549-a068-16f9cfafbc4b service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:26.816716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-324ec5ab-6514-425a-adf0-6e3315418004 req-10349e62-07d3-4549-a068-16f9cfafbc4b service nova] Creating event network-changed:c7e7af63-dba4-40f2-b97e-3dc8a5d14124 for instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 on hv-cinder-82413 Jan 11 14:17:26.822268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-324ec5ab-6514-425a-adf0-6e3315418004 req-10349e62-07d3-4549-a068-16f9cfafbc4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046337 Jan 11 14:17:26.823207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 364/746] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:27.314236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e937bfc6-bb37-4e29-9ad8-1fb7677a4687 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:27.314768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e937bfc6-bb37-4e29-9ad8-1fb7677a4687 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:27.321018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e937bfc6-bb37-4e29-9ad8-1fb7677a4687 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:27.321475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e937bfc6-bb37-4e29-9ad8-1fb7677a4687 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:27.322291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e937bfc6-bb37-4e29-9ad8-1fb7677a4687 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:27.322731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e937bfc6-bb37-4e29-9ad8-1fb7677a4687 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:27.551465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e937bfc6-bb37-4e29-9ad8-1fb7677a4687 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:27.559435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e937bfc6-bb37-4e29-9ad8-1fb7677a4687 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.248258 Jan 11 14:17:27.560040 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 383/747] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:27 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:27.606230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:27.606919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:27.613133 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:27.613584 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:27.614356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:27.614784 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:27.783156 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:27.791008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:27.792536 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:27.794255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-009a0181-aa47-4864-9a9f-9d130b056ecd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.193324 Jan 11 14:17:27.794806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 365/748] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:27 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:28.148530 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e14191c5-717a-49fb-97b1-3b9ce7353496 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:28.149030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e14191c5-717a-49fb-97b1-3b9ce7353496 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:28.156653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e14191c5-717a-49fb-97b1-3b9ce7353496 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:28.157131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e14191c5-717a-49fb-97b1-3b9ce7353496 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:28.157923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e14191c5-717a-49fb-97b1-3b9ce7353496 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:28.158349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e14191c5-717a-49fb-97b1-3b9ce7353496 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:28.234833 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-e14191c5-717a-49fb-97b1-3b9ce7353496 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lazy-loading 'services' on Instance uuid 15c7cf3b-e6db-481d-a653-c246c1a5559a {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:17:28.342697 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e14191c5-717a-49fb-97b1-3b9ce7353496 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "DELETE /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments/19548d0a-d78c-4dd1-9e43-6f39b1266102" status: 202 len: 0 microversion: 2.1 time: 0.197572 Jan 11 14:17:28.344554 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 384/749] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:17:28 2022] DELETE /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments/19548d0a-d78c-4dd1-9e43-6f39b1266102 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:17:28.353512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d24e328e-8b31-4961-b048-91f39a3a4e6a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:28.354948 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d24e328e-8b31-4961-b048-91f39a3a4e6a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:28.362233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d24e328e-8b31-4961-b048-91f39a3a4e6a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:28.362963 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d24e328e-8b31-4961-b048-91f39a3a4e6a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:28.363915 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d24e328e-8b31-4961-b048-91f39a3a4e6a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:28.364641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d24e328e-8b31-4961-b048-91f39a3a4e6a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:28.404678 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d24e328e-8b31-4961-b048-91f39a3a4e6a tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055623 Jan 11 14:17:28.405518 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 366/750] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:28 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:28.576657 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5f425897-e8f1-4cdb-ab89-4216c727a9fc tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:28.577350 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5f425897-e8f1-4cdb-ab89-4216c727a9fc tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:28.583553 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5f425897-e8f1-4cdb-ab89-4216c727a9fc tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:28.583952 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5f425897-e8f1-4cdb-ab89-4216c727a9fc tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:28.584931 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5f425897-e8f1-4cdb-ab89-4216c727a9fc tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:28.585780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5f425897-e8f1-4cdb-ab89-4216c727a9fc tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:28.729892 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5f425897-e8f1-4cdb-ab89-4216c727a9fc tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:28.738164 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5f425897-e8f1-4cdb-ab89-4216c727a9fc tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.166354 Jan 11 14:17:28.738814 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 385/751] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:28 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:28.811656 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:28.812265 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:28.818364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:28.818862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:28.819681 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:28.820150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:28.953627 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:28.961437 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:28.963065 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:28.964266 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-55d00cd9-5c82-4366-9546-2a56eea731ef tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.156887 Jan 11 14:17:28.964820 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 367/752] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:28 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:29.013908 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ad5d2d74-b44e-42ab-93bf-ffab311b7bd0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:29.014414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ad5d2d74-b44e-42ab-93bf-ffab311b7bd0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:29.022750 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ad5d2d74-b44e-42ab-93bf-ffab311b7bd0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.023206 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ad5d2d74-b44e-42ab-93bf-ffab311b7bd0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.024026 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ad5d2d74-b44e-42ab-93bf-ffab311b7bd0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.024467 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ad5d2d74-b44e-42ab-93bf-ffab311b7bd0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.050108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ad5d2d74-b44e-42ab-93bf-ffab311b7bd0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:17:29.127337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ad5d2d74-b44e-42ab-93bf-ffab311b7bd0 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 204 len: 0 microversion: 2.1 time: 0.116958 Jan 11 14:17:29.127958 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 386/753] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:17:29 2022] DELETE /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:17:29.136730 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-322e608f-184e-4c36-a4c3-fb841f614560 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:29.137379 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-322e608f-184e-4c36-a4c3-fb841f614560 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:29.143199 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-322e608f-184e-4c36-a4c3-fb841f614560 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.143728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-322e608f-184e-4c36-a4c3-fb841f614560 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.144566 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-322e608f-184e-4c36-a4c3-fb841f614560 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.145008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-322e608f-184e-4c36-a4c3-fb841f614560 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.282686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-322e608f-184e-4c36-a4c3-fb841f614560 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:29.289877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-322e608f-184e-4c36-a4c3-fb841f614560 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1513 microversion: 2.1 time: 0.156915 Jan 11 14:17:29.290444 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 368/754] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:29 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:29.417030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-30ce5bba-481c-4807-bfab-889691cb6b20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:29.418116 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-30ce5bba-481c-4807-bfab-889691cb6b20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:29.424214 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-30ce5bba-481c-4807-bfab-889691cb6b20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.427441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-30ce5bba-481c-4807-bfab-889691cb6b20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.427441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-30ce5bba-481c-4807-bfab-889691cb6b20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.427441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-30ce5bba-481c-4807-bfab-889691cb6b20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.458264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-30ce5bba-481c-4807-bfab-889691cb6b20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Jan 11 14:17:29.458754 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 387/755] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:29 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:29.754266 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-040d9d8d-0715-48d5-8696-3f42af3e5803 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:29.754944 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-040d9d8d-0715-48d5-8696-3f42af3e5803 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:29.761084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-040d9d8d-0715-48d5-8696-3f42af3e5803 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.761598 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-040d9d8d-0715-48d5-8696-3f42af3e5803 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.763118 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-040d9d8d-0715-48d5-8696-3f42af3e5803 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.763652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-040d9d8d-0715-48d5-8696-3f42af3e5803 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.907117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-040d9d8d-0715-48d5-8696-3f42af3e5803 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:29.914453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-040d9d8d-0715-48d5-8696-3f42af3e5803 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.163903 Jan 11 14:17:29.915015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 369/756] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:29 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:29.981748 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:29.982357 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:29.989114 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.989566 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:29.990349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:29.990782 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:30.130942 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:30.139257 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:30.140798 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:30.141938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ffbb0db9-bb63-4c4d-a6fc-97fab1b9b049 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.163895 Jan 11 14:17:30.142696 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 388/757] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:29 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:30.305995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b5517d8d-dbb0-4c0a-8a2e-60e08bc8c1a9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:30.306603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b5517d8d-dbb0-4c0a-8a2e-60e08bc8c1a9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:30.312796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b5517d8d-dbb0-4c0a-8a2e-60e08bc8c1a9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:30.313247 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b5517d8d-dbb0-4c0a-8a2e-60e08bc8c1a9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:30.314025 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b5517d8d-dbb0-4c0a-8a2e-60e08bc8c1a9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:30.314462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b5517d8d-dbb0-4c0a-8a2e-60e08bc8c1a9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:30.448616 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b5517d8d-dbb0-4c0a-8a2e-60e08bc8c1a9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:30.457113 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b5517d8d-dbb0-4c0a-8a2e-60e08bc8c1a9 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1513 microversion: 2.1 time: 0.154842 Jan 11 14:17:30.457808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 370/758] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:30 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:30.469687 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-190a0e3b-a05b-4578-af94-49addc5df3b6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:30.470597 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-190a0e3b-a05b-4578-af94-49addc5df3b6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:30.476967 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-190a0e3b-a05b-4578-af94-49addc5df3b6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:30.477410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-190a0e3b-a05b-4578-af94-49addc5df3b6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:30.478179 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-190a0e3b-a05b-4578-af94-49addc5df3b6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:30.478607 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-190a0e3b-a05b-4578-af94-49addc5df3b6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:30.507995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-190a0e3b-a05b-4578-af94-49addc5df3b6 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 Jan 11 14:17:30.508541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 389/759] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:30 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:30.933215 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ec8171e8-af10-4582-9a93-b20f520d1c45 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:30.933215 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ec8171e8-af10-4582-9a93-b20f520d1c45 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:30.940319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ec8171e8-af10-4582-9a93-b20f520d1c45 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:30.940895 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ec8171e8-af10-4582-9a93-b20f520d1c45 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:30.942818 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ec8171e8-af10-4582-9a93-b20f520d1c45 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:30.943725 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ec8171e8-af10-4582-9a93-b20f520d1c45 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:31.073646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ec8171e8-af10-4582-9a93-b20f520d1c45 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:31.082142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ec8171e8-af10-4582-9a93-b20f520d1c45 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.154359 Jan 11 14:17:31.082796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 371/760] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:30 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:31.159538 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:31.160207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:31.166320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:31.166776 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:31.167584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:31.168710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:31.305732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:31.314241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:31.315953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:31.317256 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a62769c6-06cb-46a2-9caa-44e9c237cf63 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.161670 Jan 11 14:17:31.317894 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 390/761] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:31 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:31.473816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c4c72517-0b69-4660-bb08-575797b74ef1 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:31.474426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c4c72517-0b69-4660-bb08-575797b74ef1 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:31.480162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c4c72517-0b69-4660-bb08-575797b74ef1 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:31.480652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c4c72517-0b69-4660-bb08-575797b74ef1 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:31.481482 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c4c72517-0b69-4660-bb08-575797b74ef1 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:31.481919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c4c72517-0b69-4660-bb08-575797b74ef1 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:31.519220 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ae4f9502-9fcd-458a-94b0-dccafacf4fdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:31.520070 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ae4f9502-9fcd-458a-94b0-dccafacf4fdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:31.526171 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae4f9502-9fcd-458a-94b0-dccafacf4fdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:31.526614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae4f9502-9fcd-458a-94b0-dccafacf4fdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:31.527947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae4f9502-9fcd-458a-94b0-dccafacf4fdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:31.528551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae4f9502-9fcd-458a-94b0-dccafacf4fdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:31.556960 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ae4f9502-9fcd-458a-94b0-dccafacf4fdd tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041445 Jan 11 14:17:31.557516 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 391/762] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:31 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:17:31.694141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c4c72517-0b69-4660-bb08-575797b74ef1 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bd3500319e438693757912c1938a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b10949b6e5a439990bd8563f61eca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:31.702753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c4c72517-0b69-4660-bb08-575797b74ef1 tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 200 len: 1513 microversion: 2.1 time: 0.232532 Jan 11 14:17:31.703461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 372/763] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:31 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:31.843263 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-1968029c-3e62-4c16-8314-b363f9f16e7e req-de7b6677-1545-46bc-ba3b-aabb83439f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f638f3d-a3ed-4ba6-9310-81ab620fe882", "name": "network-vif-deleted", "tag": "8232801e-c8a6-4b58-9700-b2811cddf236"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:31.844933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:17:31.844933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:17:31.852023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-1968029c-3e62-4c16-8314-b363f9f16e7e req-de7b6677-1545-46bc-ba3b-aabb83439f72 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:31.852464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-1968029c-3e62-4c16-8314-b363f9f16e7e req-de7b6677-1545-46bc-ba3b-aabb83439f72 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:31.863884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-1968029c-3e62-4c16-8314-b363f9f16e7e req-de7b6677-1545-46bc-ba3b-aabb83439f72 service nova] Creating event network-vif-deleted:8232801e-c8a6-4b58-9700-b2811cddf236 for instance 8f638f3d-a3ed-4ba6-9310-81ab620fe882 on hv-cinder-82413 Jan 11 14:17:31.868745 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-1968029c-3e62-4c16-8314-b363f9f16e7e req-de7b6677-1545-46bc-ba3b-aabb83439f72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028954 Jan 11 14:17:31.869403 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 392/764] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:32.098683 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f13b179b-4d27-47d1-b38b-68497514ee36 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:32.099260 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f13b179b-4d27-47d1-b38b-68497514ee36 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:32.105360 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f13b179b-4d27-47d1-b38b-68497514ee36 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:32.105825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f13b179b-4d27-47d1-b38b-68497514ee36 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:32.106592 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f13b179b-4d27-47d1-b38b-68497514ee36 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:32.107021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f13b179b-4d27-47d1-b38b-68497514ee36 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:32.237882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f13b179b-4d27-47d1-b38b-68497514ee36 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:32.245599 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f13b179b-4d27-47d1-b38b-68497514ee36 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.150630 Jan 11 14:17:32.246166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 373/765] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:32 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:32.337933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:32.338634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:32.345357 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:32.345809 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:32.346595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:32.347037 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:32.485818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:32.494520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:32.496734 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:32.498010 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2f00242f-f272-40be-b434-90b99d008eb6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.164024 Jan 11 14:17:32.498559 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 393/766] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:32 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:32.568779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a56c9771-c71e-431f-bd5a-29d3b307bc58 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:32.569715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a56c9771-c71e-431f-bd5a-29d3b307bc58 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:32.576256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a56c9771-c71e-431f-bd5a-29d3b307bc58 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:32.576710 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a56c9771-c71e-431f-bd5a-29d3b307bc58 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:32.577487 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a56c9771-c71e-431f-bd5a-29d3b307bc58 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:32.577930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a56c9771-c71e-431f-bd5a-29d3b307bc58 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:32.606253 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a56c9771-c71e-431f-bd5a-29d3b307bc58 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041345 Jan 11 14:17:32.606806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 374/767] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:32 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:32.719584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:32.720205 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] [instance: 8f638f3d-a3ed-4ba6-9310-81ab620fe882] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:32.726676 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:32.727130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:32.727937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:32.728374 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:32.741889 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] HTTP exception thrown: Instance 8f638f3d-a3ed-4ba6-9310-81ab620fe882 could not be found. Jan 11 14:17:32.742466 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] Returning 404 to user: Instance 8f638f3d-a3ed-4ba6-9310-81ab620fe882 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:17:32.743297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e6b3b3b4-23b3-42e2-b357-ec90bafe6d9c tempest-VolumesSnapshotTestJSON-750512282 tempest-VolumesSnapshotTestJSON-750512282-project] 10.222.0.49 "GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882" status: 404 len: 111 microversion: 2.1 time: 0.027416 Jan 11 14:17:32.743858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 394/768] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:32 2022] GET /compute/v2.1/servers/8f638f3d-a3ed-4ba6-9310-81ab620fe882 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:17:33.262508 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-106bb5e6-a312-42db-921a-2b227a9388b0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:33.263175 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-106bb5e6-a312-42db-921a-2b227a9388b0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:33.269289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-106bb5e6-a312-42db-921a-2b227a9388b0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:33.269732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-106bb5e6-a312-42db-921a-2b227a9388b0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:33.270513 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-106bb5e6-a312-42db-921a-2b227a9388b0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:33.270940 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-106bb5e6-a312-42db-921a-2b227a9388b0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:33.397491 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-106bb5e6-a312-42db-921a-2b227a9388b0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:33.404596 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-106bb5e6-a312-42db-921a-2b227a9388b0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.146392 Jan 11 14:17:33.405157 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 375/769] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:33 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:33.525436 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:33.526067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:33.532231 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:33.532914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:33.533889 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:33.534493 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:33.617165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9b0e98e5-c9db-4870-9efc-dab353f89788 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:33.618106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9b0e98e5-c9db-4870-9efc-dab353f89788 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:33.624171 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9b0e98e5-c9db-4870-9efc-dab353f89788 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:33.624619 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9b0e98e5-c9db-4870-9efc-dab353f89788 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:33.625578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9b0e98e5-c9db-4870-9efc-dab353f89788 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:33.626017 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9b0e98e5-c9db-4870-9efc-dab353f89788 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:33.657594 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9b0e98e5-c9db-4870-9efc-dab353f89788 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Jan 11 14:17:33.658163 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 376/770] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:33 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:33.667977 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:33.676269 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:33.677775 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:33.678920 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-633b4ad7-2b12-4130-837d-46e26b8552f6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.157208 Jan 11 14:17:33.679464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 395/771] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:33 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:34.425732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b48b0d87-6d5b-4059-bdbd-fdd15d16c4f5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:34.426335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b48b0d87-6d5b-4059-bdbd-fdd15d16c4f5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:34.433043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b48b0d87-6d5b-4059-bdbd-fdd15d16c4f5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:34.433551 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b48b0d87-6d5b-4059-bdbd-fdd15d16c4f5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:34.434845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b48b0d87-6d5b-4059-bdbd-fdd15d16c4f5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:34.435446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b48b0d87-6d5b-4059-bdbd-fdd15d16c4f5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:34.624893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b48b0d87-6d5b-4059-bdbd-fdd15d16c4f5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:34.632056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b48b0d87-6d5b-4059-bdbd-fdd15d16c4f5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.209925 Jan 11 14:17:34.632621 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 377/772] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:34 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:34.670234 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1f9fc9c7-84f0-46a7-9225-23245fababc9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:34.670998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1f9fc9c7-84f0-46a7-9225-23245fababc9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:34.678059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1f9fc9c7-84f0-46a7-9225-23245fababc9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:34.678317 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1f9fc9c7-84f0-46a7-9225-23245fababc9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:34.679106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1f9fc9c7-84f0-46a7-9225-23245fababc9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:34.679567 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1f9fc9c7-84f0-46a7-9225-23245fababc9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:34.705233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:34.705847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:34.712822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:34.713496 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:34.714480 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:34.715667 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:34.722393 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1f9fc9c7-84f0-46a7-9225-23245fababc9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057294 Jan 11 14:17:34.722966 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 396/773] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:34 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:34.851605 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:34.858065 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:34.859641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:34.860804 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-04339c29-638c-4aa0-a747-b74af4fe9271 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.159334 Jan 11 14:17:34.861740 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 378/774] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:34 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:35.647887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4acc5ab1-9dce-49e6-b802-0bc499e52d9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:35.648618 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4acc5ab1-9dce-49e6-b802-0bc499e52d9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:35.655169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4acc5ab1-9dce-49e6-b802-0bc499e52d9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:35.655876 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4acc5ab1-9dce-49e6-b802-0bc499e52d9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:35.657117 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4acc5ab1-9dce-49e6-b802-0bc499e52d9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:35.657967 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4acc5ab1-9dce-49e6-b802-0bc499e52d9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:35.735261 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-da4358b3-ef44-488b-adbe-390de32d09b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:35.736258 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-da4358b3-ef44-488b-adbe-390de32d09b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:35.742487 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-da4358b3-ef44-488b-adbe-390de32d09b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:35.742937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-da4358b3-ef44-488b-adbe-390de32d09b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:35.743745 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-da4358b3-ef44-488b-adbe-390de32d09b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:35.744466 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-da4358b3-ef44-488b-adbe-390de32d09b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:35.775126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-da4358b3-ef44-488b-adbe-390de32d09b9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Jan 11 14:17:35.775711 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 379/775] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:35 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:17:35.801059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4acc5ab1-9dce-49e6-b802-0bc499e52d9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:35.808622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4acc5ab1-9dce-49e6-b802-0bc499e52d9c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.164091 Jan 11 14:17:35.809180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 397/776] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:35 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:35.879567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:35.880121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:35.886126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:35.887148 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:35.887902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:35.888342 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:36.018106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:36.025726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:36.027856 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:36.029005 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2ef12c96-d60a-44b0-afb7-2396c95172d6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.153549 Jan 11 14:17:36.029558 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 380/777] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:35 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:36.785940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d65ed10e-86dc-4d57-9a3a-015948bc7213 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:36.786835 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d65ed10e-86dc-4d57-9a3a-015948bc7213 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:36.793924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d65ed10e-86dc-4d57-9a3a-015948bc7213 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:36.794366 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d65ed10e-86dc-4d57-9a3a-015948bc7213 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:36.795138 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d65ed10e-86dc-4d57-9a3a-015948bc7213 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:36.795597 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d65ed10e-86dc-4d57-9a3a-015948bc7213 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:36.825147 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d65ed10e-86dc-4d57-9a3a-015948bc7213 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042311 Jan 11 14:17:36.825782 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1720efc8-16a4-4c7f-9616-7fcab1977553 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:36.826136 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 398/778] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:36 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:36.826226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1720efc8-16a4-4c7f-9616-7fcab1977553 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:36.832578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1720efc8-16a4-4c7f-9616-7fcab1977553 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:36.833020 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1720efc8-16a4-4c7f-9616-7fcab1977553 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:36.833793 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1720efc8-16a4-4c7f-9616-7fcab1977553 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:36.834226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1720efc8-16a4-4c7f-9616-7fcab1977553 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:36.964106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1720efc8-16a4-4c7f-9616-7fcab1977553 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:36.971727 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1720efc8-16a4-4c7f-9616-7fcab1977553 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.150842 Jan 11 14:17:36.972289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 381/779] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:36 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:37.046689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:37.047302 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:37.053106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.053579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:37.054346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.054787 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:37.185665 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:37.193413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:37.194933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:37.196166 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7836effb-8df6-4535-8d80-c2a966528435 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.153141 Jan 11 14:17:37.196712 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 399/780] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:37 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:37.816087 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-bbdec9a1-b421-490f-ab71-62fed1b82475 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:37.821905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bbdec9a1-b421-490f-ab71-62fed1b82475 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.822350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bbdec9a1-b421-490f-ab71-62fed1b82475 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:37.835067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4a041182-e60d-47e1-aa2b-063085c6b74c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:37.836050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4a041182-e60d-47e1-aa2b-063085c6b74c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:37.842697 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a041182-e60d-47e1-aa2b-063085c6b74c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.843137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a041182-e60d-47e1-aa2b-063085c6b74c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:37.843927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a041182-e60d-47e1-aa2b-063085c6b74c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.844355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a041182-e60d-47e1-aa2b-063085c6b74c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:37.873354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4a041182-e60d-47e1-aa2b-063085c6b74c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041895 Jan 11 14:17:37.873903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 400/781] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:37 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:17:37.882766 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-bbdec9a1-b421-490f-ab71-62fed1b82475 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Going to try to stop instance {{(pid=116475) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 11 14:17:37.925928 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-bbdec9a1-b421-490f-ab71-62fed1b82475 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 202 len: 0 microversion: 2.1 time: 0.113346 Jan 11 14:17:37.926525 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 382/782] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:17:37 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:17:37.934716 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ce1258ea-9f92-480b-832a-fe5525d12e6b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:37.935316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ce1258ea-9f92-480b-832a-fe5525d12e6b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:37.941214 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce1258ea-9f92-480b-832a-fe5525d12e6b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.941656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce1258ea-9f92-480b-832a-fe5525d12e6b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:37.942420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce1258ea-9f92-480b-832a-fe5525d12e6b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.942855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce1258ea-9f92-480b-832a-fe5525d12e6b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:37.988175 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d49ba4d6-9a4e-41fd-8cca-174a4bbf08cf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:37.988786 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d49ba4d6-9a4e-41fd-8cca-174a4bbf08cf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:37.994676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d49ba4d6-9a4e-41fd-8cca-174a4bbf08cf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.995117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d49ba4d6-9a4e-41fd-8cca-174a4bbf08cf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:37.995932 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d49ba4d6-9a4e-41fd-8cca-174a4bbf08cf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:37.996364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d49ba4d6-9a4e-41fd-8cca-174a4bbf08cf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:38.102465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ce1258ea-9f92-480b-832a-fe5525d12e6b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:38.110369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ce1258ea-9f92-480b-832a-fe5525d12e6b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.179263 Jan 11 14:17:38.110933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 401/783] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:37 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:38.158662 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d49ba4d6-9a4e-41fd-8cca-174a4bbf08cf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:38.166040 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d49ba4d6-9a4e-41fd-8cca-174a4bbf08cf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.181964 Jan 11 14:17:38.166620 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 383/784] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:37 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:38.213744 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:38.214353 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:38.220802 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:38.221241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:38.222007 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:38.222432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:38.554950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:38.563120 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:38.564684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:38.565811 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-99716c3d-0d30-4197-a844-95d3095206d4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.355742 Jan 11 14:17:38.566356 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 402/785] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:38 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:38.884479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-90ff4a94-b42a-4c65-898e-426293527ac5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:38.885528 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-90ff4a94-b42a-4c65-898e-426293527ac5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:38.891647 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-90ff4a94-b42a-4c65-898e-426293527ac5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:38.892089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-90ff4a94-b42a-4c65-898e-426293527ac5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:38.892853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-90ff4a94-b42a-4c65-898e-426293527ac5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:38.893281 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-90ff4a94-b42a-4c65-898e-426293527ac5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:38.922709 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-90ff4a94-b42a-4c65-898e-426293527ac5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041928 Jan 11 14:17:38.923255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 384/786] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:38 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:39.127863 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ff95f625-cca7-433b-9160-83397d8325ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:39.128422 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ff95f625-cca7-433b-9160-83397d8325ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:39.134598 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ff95f625-cca7-433b-9160-83397d8325ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.135038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ff95f625-cca7-433b-9160-83397d8325ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.135836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ff95f625-cca7-433b-9160-83397d8325ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.136267 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ff95f625-cca7-433b-9160-83397d8325ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.181844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-aac43eae-9b20-4cc8-afff-41a9a52b5432 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:39.182458 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-aac43eae-9b20-4cc8-afff-41a9a52b5432 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:39.195167 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aac43eae-9b20-4cc8-afff-41a9a52b5432 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.196107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aac43eae-9b20-4cc8-afff-41a9a52b5432 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.197710 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aac43eae-9b20-4cc8-afff-41a9a52b5432 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.198281 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aac43eae-9b20-4cc8-afff-41a9a52b5432 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.305035 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ff95f625-cca7-433b-9160-83397d8325ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:39.314689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ff95f625-cca7-433b-9160-83397d8325ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.190323 Jan 11 14:17:39.326309 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 403/787] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:39 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:39.332722 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-53186366-3a88-4756-a537-6d18b275b093 req-a4006098-d9c1-4a86-ab32-2c548082ced7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "682faefe-6922-4f9f-b5b8-48b8c9a49665", "name": "network-vif-plugged", "status": "completed", "tag": "c7e7af63-dba4-40f2-b97e-3dc8a5d14124"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:17:39.334524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:17:39.334524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:17:39.344649 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-53186366-3a88-4756-a537-6d18b275b093 req-a4006098-d9c1-4a86-ab32-2c548082ced7 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.350940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-53186366-3a88-4756-a537-6d18b275b093 req-a4006098-d9c1-4a86-ab32-2c548082ced7 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.357880 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-53186366-3a88-4756-a537-6d18b275b093 req-a4006098-d9c1-4a86-ab32-2c548082ced7 service nova] Creating event network-vif-plugged:c7e7af63-dba4-40f2-b97e-3dc8a5d14124 for instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 on hv-cinder-82413 Jan 11 14:17:39.363325 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-53186366-3a88-4756-a537-6d18b275b093 req-a4006098-d9c1-4a86-ab32-2c548082ced7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Jan 11 14:17:39.364381 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 404/788] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:39.380657 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-aac43eae-9b20-4cc8-afff-41a9a52b5432 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:39.388644 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-aac43eae-9b20-4cc8-afff-41a9a52b5432 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.210414 Jan 11 14:17:39.396033 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 385/789] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:39 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:39.584680 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:39.586025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:39.593150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.593804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.594779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.595575 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.785180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:39.792867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:39.794473 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:39.795724 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-890d8657-32eb-40d8-91e1-1fc2560f19f7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.215106 Jan 11 14:17:39.796284 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 405/790] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:39 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:39.934659 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e21a3124-368a-4691-85b0-c418873d98a8 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:39.935603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e21a3124-368a-4691-85b0-c418873d98a8 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:39.941511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e21a3124-368a-4691-85b0-c418873d98a8 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.941964 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e21a3124-368a-4691-85b0-c418873d98a8 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.942749 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e21a3124-368a-4691-85b0-c418873d98a8 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:39.943188 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e21a3124-368a-4691-85b0-c418873d98a8 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:39.974011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e21a3124-368a-4691-85b0-c418873d98a8 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043559 Jan 11 14:17:39.974863 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 386/791] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:39 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:40.331843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f461be6a-f8ac-4fe3-949f-24935b126c02 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:40.332445 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f461be6a-f8ac-4fe3-949f-24935b126c02 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:40.338623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f461be6a-f8ac-4fe3-949f-24935b126c02 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:40.339065 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f461be6a-f8ac-4fe3-949f-24935b126c02 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:40.339872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f461be6a-f8ac-4fe3-949f-24935b126c02 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:40.340301 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f461be6a-f8ac-4fe3-949f-24935b126c02 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:40.404969 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ade09fdd-22eb-4a92-8622-5a53b1537a80 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:40.405659 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ade09fdd-22eb-4a92-8622-5a53b1537a80 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:40.411341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ade09fdd-22eb-4a92-8622-5a53b1537a80 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:40.411824 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ade09fdd-22eb-4a92-8622-5a53b1537a80 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:40.412604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ade09fdd-22eb-4a92-8622-5a53b1537a80 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:40.413039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ade09fdd-22eb-4a92-8622-5a53b1537a80 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:40.489352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f461be6a-f8ac-4fe3-949f-24935b126c02 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:40.497710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f461be6a-f8ac-4fe3-949f-24935b126c02 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.169489 Jan 11 14:17:40.498369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 406/792] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:40 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:40.556353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ade09fdd-22eb-4a92-8622-5a53b1537a80 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:40.563558 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ade09fdd-22eb-4a92-8622-5a53b1537a80 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.162225 Jan 11 14:17:40.564128 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 387/793] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:40 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:40.814100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:40.814707 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:40.820492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:40.820940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:40.821716 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:40.822157 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:40.950203 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:40.958065 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:40.959913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:40.961059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ac1b6eef-3961-4e84-9bac-795b734253ed tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.150675 Jan 11 14:17:40.961614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 407/794] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:40 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:40.984931 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ba360f8a-3001-477b-b13c-b13a228dcb8e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:40.985863 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ba360f8a-3001-477b-b13c-b13a228dcb8e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:40.992046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba360f8a-3001-477b-b13c-b13a228dcb8e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:40.992488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba360f8a-3001-477b-b13c-b13a228dcb8e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:40.993255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba360f8a-3001-477b-b13c-b13a228dcb8e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:40.993683 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba360f8a-3001-477b-b13c-b13a228dcb8e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:41.021385 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ba360f8a-3001-477b-b13c-b13a228dcb8e tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040143 Jan 11 14:17:41.021917 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 388/795] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:17:40 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:17:41.514600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f3cf1807-419e-4c8b-a8f8-ace0ec95f6ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:41.515198 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f3cf1807-419e-4c8b-a8f8-ace0ec95f6ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:41.521383 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3cf1807-419e-4c8b-a8f8-ace0ec95f6ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:41.521828 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3cf1807-419e-4c8b-a8f8-ace0ec95f6ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:41.522595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3cf1807-419e-4c8b-a8f8-ace0ec95f6ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:41.523024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3cf1807-419e-4c8b-a8f8-ace0ec95f6ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:41.580027 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a5c87a9d-4d91-4ad6-8654-0002656febc5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:41.580700 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a5c87a9d-4d91-4ad6-8654-0002656febc5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:41.586618 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a5c87a9d-4d91-4ad6-8654-0002656febc5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:41.587064 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a5c87a9d-4d91-4ad6-8654-0002656febc5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:41.587876 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a5c87a9d-4d91-4ad6-8654-0002656febc5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:41.588310 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a5c87a9d-4d91-4ad6-8654-0002656febc5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:41.680983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f3cf1807-419e-4c8b-a8f8-ace0ec95f6ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:41.689075 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f3cf1807-419e-4c8b-a8f8-ace0ec95f6ef tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.178066 Jan 11 14:17:41.689648 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 408/796] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:41 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:41.741010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a5c87a9d-4d91-4ad6-8654-0002656febc5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:41.748300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a5c87a9d-4d91-4ad6-8654-0002656febc5 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.171861 Jan 11 14:17:41.749083 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 389/797] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:41 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:41.979332 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:41.979956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:41.985940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:41.986379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:41.987142 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:41.987600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:42.113374 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:42.121376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:42.122862 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:42.124033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ed25d1a7-fd85-4830-a931-8f68dd8b2efc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.148409 Jan 11 14:17:42.124574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 409/798] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:41 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:42.706059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-41656710-019c-4090-a62e-054175face45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:42.706687 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-41656710-019c-4090-a62e-054175face45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:42.713026 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-41656710-019c-4090-a62e-054175face45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:42.713509 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-41656710-019c-4090-a62e-054175face45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:42.714293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-41656710-019c-4090-a62e-054175face45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:42.715397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-41656710-019c-4090-a62e-054175face45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:42.766462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-781167ae-4623-4e00-9c8a-ab6e7277d917 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:42.767904 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-781167ae-4623-4e00-9c8a-ab6e7277d917 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:42.775718 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-781167ae-4623-4e00-9c8a-ab6e7277d917 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:42.776748 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-781167ae-4623-4e00-9c8a-ab6e7277d917 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:42.778319 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-781167ae-4623-4e00-9c8a-ab6e7277d917 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:42.779612 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-781167ae-4623-4e00-9c8a-ab6e7277d917 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:42.899693 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-41656710-019c-4090-a62e-054175face45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:42.907901 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-41656710-019c-4090-a62e-054175face45 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.205508 Jan 11 14:17:42.908502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 390/799] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:42 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:42.942406 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-781167ae-4623-4e00-9c8a-ab6e7277d917 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:42.951353 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-781167ae-4623-4e00-9c8a-ab6e7277d917 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.190176 Jan 11 14:17:42.951950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 410/800] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:42 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:43.141721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:43.142321 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:43.148271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:43.148499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:43.149272 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:43.149705 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:43.275534 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:43.283199 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:43.284736 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:43.285878 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d09518c3-5d27-4256-9446-55181f177b6d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.147780 Jan 11 14:17:43.286432 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 391/801] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:43 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:43.924674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-86ac6852-123d-4b30-83df-035085f7c415 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:43.925281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-86ac6852-123d-4b30-83df-035085f7c415 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:43.931629 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-86ac6852-123d-4b30-83df-035085f7c415 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:43.932081 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-86ac6852-123d-4b30-83df-035085f7c415 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:43.932855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-86ac6852-123d-4b30-83df-035085f7c415 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:43.933290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-86ac6852-123d-4b30-83df-035085f7c415 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:43.968221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9fdd8fed-621b-477f-a80d-55eea08dd599 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:43.968760 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9fdd8fed-621b-477f-a80d-55eea08dd599 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:43.974907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9fdd8fed-621b-477f-a80d-55eea08dd599 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:43.975357 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9fdd8fed-621b-477f-a80d-55eea08dd599 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:43.976176 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9fdd8fed-621b-477f-a80d-55eea08dd599 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:43.976613 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9fdd8fed-621b-477f-a80d-55eea08dd599 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:44.101378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-86ac6852-123d-4b30-83df-035085f7c415 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:44.109116 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-86ac6852-123d-4b30-83df-035085f7c415 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.188098 Jan 11 14:17:44.109680 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 411/802] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:43 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:44.144187 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9fdd8fed-621b-477f-a80d-55eea08dd599 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:44.151484 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9fdd8fed-621b-477f-a80d-55eea08dd599 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.187294 Jan 11 14:17:44.152671 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 392/803] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:43 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:44.303203 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:44.303835 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:44.310162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:44.310604 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:44.311372 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:44.311822 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:44.441009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:44.448576 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:44.450943 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:44.452106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0dce4011-22f2-4371-92c0-33dd2c28eea5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.152563 Jan 11 14:17:44.452647 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 412/804] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:44 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:45.125834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4335f193-1dc8-46c5-b3ff-134ccfa11f48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:45.126440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4335f193-1dc8-46c5-b3ff-134ccfa11f48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:45.132644 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4335f193-1dc8-46c5-b3ff-134ccfa11f48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:45.133101 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4335f193-1dc8-46c5-b3ff-134ccfa11f48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:45.133875 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4335f193-1dc8-46c5-b3ff-134ccfa11f48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:45.134317 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4335f193-1dc8-46c5-b3ff-134ccfa11f48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:45.168748 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ffa7b7f8-f9f1-49e9-a439-7f57a3678732 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:45.169447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ffa7b7f8-f9f1-49e9-a439-7f57a3678732 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:45.175918 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffa7b7f8-f9f1-49e9-a439-7f57a3678732 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:45.176438 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffa7b7f8-f9f1-49e9-a439-7f57a3678732 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:45.177305 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffa7b7f8-f9f1-49e9-a439-7f57a3678732 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:45.177802 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffa7b7f8-f9f1-49e9-a439-7f57a3678732 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:45.329051 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4335f193-1dc8-46c5-b3ff-134ccfa11f48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:45.340593 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4335f193-1dc8-46c5-b3ff-134ccfa11f48 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.217561 Jan 11 14:17:45.358271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 393/805] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:45 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:45.368301 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ffa7b7f8-f9f1-49e9-a439-7f57a3678732 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:45.376920 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ffa7b7f8-f9f1-49e9-a439-7f57a3678732 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.212091 Jan 11 14:17:45.387254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 413/806] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:45 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:45.470539 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:45.471084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:45.476878 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:45.477474 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:45.478253 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:45.478690 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:45.609589 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:45.617230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:45.618757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:45.620129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2c11fe90-340f-4d29-8ef5-a21df8b1f7d1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.153414 Jan 11 14:17:45.620710 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 394/807] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:45 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:46.357731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2a6e494e-e284-430d-8391-cb879fde09e8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:46.358262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2a6e494e-e284-430d-8391-cb879fde09e8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:46.364553 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a6e494e-e284-430d-8391-cb879fde09e8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.365003 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a6e494e-e284-430d-8391-cb879fde09e8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.365780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a6e494e-e284-430d-8391-cb879fde09e8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.366218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2a6e494e-e284-430d-8391-cb879fde09e8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.401079 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e7e4d507-6fdf-4995-bcbc-6dbc34beb6ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:46.401985 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e7e4d507-6fdf-4995-bcbc-6dbc34beb6ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:46.408447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e7e4d507-6fdf-4995-bcbc-6dbc34beb6ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.408901 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e7e4d507-6fdf-4995-bcbc-6dbc34beb6ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.409866 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e7e4d507-6fdf-4995-bcbc-6dbc34beb6ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.410302 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e7e4d507-6fdf-4995-bcbc-6dbc34beb6ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.530469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2a6e494e-e284-430d-8391-cb879fde09e8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:46.538218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2a6e494e-e284-430d-8391-cb879fde09e8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.184755 Jan 11 14:17:46.538790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 414/808] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:46 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:46.543680 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f3125634-0618-46a0-be8f-07618cc93353 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:46.544120 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f3125634-0618-46a0-be8f-07618cc93353 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:46.549549 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3125634-0618-46a0-be8f-07618cc93353 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.550006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3125634-0618-46a0-be8f-07618cc93353 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.550784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3125634-0618-46a0-be8f-07618cc93353 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.551217 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3125634-0618-46a0-be8f-07618cc93353 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.573678 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e7e4d507-6fdf-4995-bcbc-6dbc34beb6ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:46.575095 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f3125634-0618-46a0-be8f-07618cc93353 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:17:46.581165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e7e4d507-6fdf-4995-bcbc-6dbc34beb6ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.188962 Jan 11 14:17:46.581731 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 395/809] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:46 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:46.638922 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:46.639448 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:46.645390 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.645809 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.646591 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.647026 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.648818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f3125634-0618-46a0-be8f-07618cc93353 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "DELETE /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 204 len: 0 microversion: 2.1 time: 0.108770 Jan 11 14:17:46.649673 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 415/810] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:17:46 2022] DELETE /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:17:46.659338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8854164f-8af6-4e53-b8d7-d85ee7eaf40b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:46.660054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8854164f-8af6-4e53-b8d7-d85ee7eaf40b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:46.666354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8854164f-8af6-4e53-b8d7-d85ee7eaf40b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.666799 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8854164f-8af6-4e53-b8d7-d85ee7eaf40b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.668188 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8854164f-8af6-4e53-b8d7-d85ee7eaf40b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:46.668630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8854164f-8af6-4e53-b8d7-d85ee7eaf40b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:46.842113 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:46.849042 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8854164f-8af6-4e53-b8d7-d85ee7eaf40b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:46.849817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:46.851354 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:46.852552 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b7100b88-642a-46a6-a28c-734fca9f3716 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.217533 Jan 11 14:17:46.853109 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 396/811] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:46 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:46.856841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8854164f-8af6-4e53-b8d7-d85ee7eaf40b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.201754 Jan 11 14:17:46.857389 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 416/812] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:46 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:47.555466 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2e6cafbf-d184-4c1f-a61f-c6c7d46e285f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:47.556102 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2e6cafbf-d184-4c1f-a61f-c6c7d46e285f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:47.562714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2e6cafbf-d184-4c1f-a61f-c6c7d46e285f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:47.563164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2e6cafbf-d184-4c1f-a61f-c6c7d46e285f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:47.563974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2e6cafbf-d184-4c1f-a61f-c6c7d46e285f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:47.564418 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2e6cafbf-d184-4c1f-a61f-c6c7d46e285f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:47.597359 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-eaa1c578-01cd-4d97-bc30-4932a6e3d117 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:47.598053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-eaa1c578-01cd-4d97-bc30-4932a6e3d117 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:47.604492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eaa1c578-01cd-4d97-bc30-4932a6e3d117 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:47.605024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eaa1c578-01cd-4d97-bc30-4932a6e3d117 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:47.606355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eaa1c578-01cd-4d97-bc30-4932a6e3d117 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:47.607113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eaa1c578-01cd-4d97-bc30-4932a6e3d117 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:47.728613 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2e6cafbf-d184-4c1f-a61f-c6c7d46e285f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:47.737345 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2e6cafbf-d184-4c1f-a61f-c6c7d46e285f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.185400 Jan 11 14:17:47.741159 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 397/813] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:47 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:47.772446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-eaa1c578-01cd-4d97-bc30-4932a6e3d117 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:47.779723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-eaa1c578-01cd-4d97-bc30-4932a6e3d117 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.185904 Jan 11 14:17:47.780269 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 417/814] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:47 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:47.871992 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:47.872601 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:47.873545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f68d9f09-1617-4af4-aeb4-68683d57bb7c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:47.874232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f68d9f09-1617-4af4-aeb4-68683d57bb7c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:47.878477 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:47.878914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:47.879722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:47.879966 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f68d9f09-1617-4af4-aeb4-68683d57bb7c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:47.880160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:47.880416 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f68d9f09-1617-4af4-aeb4-68683d57bb7c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:47.881227 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f68d9f09-1617-4af4-aeb4-68683d57bb7c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:47.881664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f68d9f09-1617-4af4-aeb4-68683d57bb7c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:48.076995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:48.081239 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f68d9f09-1617-4af4-aeb4-68683d57bb7c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:48.085014 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:48.086524 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:48.087698 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f542c661-802d-423e-9bd7-e9ed680fb883 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.220071 Jan 11 14:17:48.088456 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 398/815] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:47 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:48.088585 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f68d9f09-1617-4af4-aeb4-68683d57bb7c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.219064 Jan 11 14:17:48.088860 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 418/816] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:47 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:48.755137 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-172e7d70-f3ab-423c-adf7-4b5bba9ae2b5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:48.755779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-172e7d70-f3ab-423c-adf7-4b5bba9ae2b5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:48.762666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-172e7d70-f3ab-423c-adf7-4b5bba9ae2b5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:48.763107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-172e7d70-f3ab-423c-adf7-4b5bba9ae2b5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:48.763913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-172e7d70-f3ab-423c-adf7-4b5bba9ae2b5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:48.764345 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-172e7d70-f3ab-423c-adf7-4b5bba9ae2b5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:48.795911 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fc53ba29-162b-49d5-8c69-38e379f46711 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:48.796515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fc53ba29-162b-49d5-8c69-38e379f46711 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:48.802664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fc53ba29-162b-49d5-8c69-38e379f46711 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:48.803104 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fc53ba29-162b-49d5-8c69-38e379f46711 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:48.803910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fc53ba29-162b-49d5-8c69-38e379f46711 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:48.804340 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fc53ba29-162b-49d5-8c69-38e379f46711 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:48.931203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-172e7d70-f3ab-423c-adf7-4b5bba9ae2b5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:48.940064 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-172e7d70-f3ab-423c-adf7-4b5bba9ae2b5 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.188531 Jan 11 14:17:48.940640 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 399/817] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:48 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:48.979704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fc53ba29-162b-49d5-8c69-38e379f46711 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:48.987682 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fc53ba29-162b-49d5-8c69-38e379f46711 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.195867 Jan 11 14:17:48.988246 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 419/818] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:48 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:49.104393 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0f9373ac-8026-4e53-8b3e-6cde00c3bbe7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:49.105505 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0f9373ac-8026-4e53-8b3e-6cde00c3bbe7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:49.106082 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:49.106684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:49.111370 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f9373ac-8026-4e53-8b3e-6cde00c3bbe7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:49.111854 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f9373ac-8026-4e53-8b3e-6cde00c3bbe7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:49.112355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:49.112648 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f9373ac-8026-4e53-8b3e-6cde00c3bbe7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:49.112804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:49.113088 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f9373ac-8026-4e53-8b3e-6cde00c3bbe7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:49.113590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:49.114025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:49.305290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0f9373ac-8026-4e53-8b3e-6cde00c3bbe7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:49.312701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0f9373ac-8026-4e53-8b3e-6cde00c3bbe7 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.211984 Jan 11 14:17:49.313281 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 400/819] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:49 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:49.316342 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:49.324384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:49.325908 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:49.327055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6a928b45-e1eb-4d96-9146-d5962c4ff5ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.225134 Jan 11 14:17:49.327640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 420/820] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:49 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:49.957290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-084ec32c-32da-4558-9b4d-256b4d91f232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:49.957895 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-084ec32c-32da-4558-9b4d-256b4d91f232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:49.964197 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-084ec32c-32da-4558-9b4d-256b4d91f232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:49.964678 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-084ec32c-32da-4558-9b4d-256b4d91f232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:49.965489 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-084ec32c-32da-4558-9b4d-256b4d91f232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:49.965911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-084ec32c-32da-4558-9b4d-256b4d91f232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:50.004795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2e9aed02-01f7-4b3b-9925-241518edf024 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:50.005414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2e9aed02-01f7-4b3b-9925-241518edf024 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:50.012224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2e9aed02-01f7-4b3b-9925-241518edf024 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:50.012677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2e9aed02-01f7-4b3b-9925-241518edf024 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:50.013467 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2e9aed02-01f7-4b3b-9925-241518edf024 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:50.013906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2e9aed02-01f7-4b3b-9925-241518edf024 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:50.139096 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-084ec32c-32da-4558-9b4d-256b4d91f232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:50.146955 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-084ec32c-32da-4558-9b4d-256b4d91f232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.193301 Jan 11 14:17:50.147547 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 401/821] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:49 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:50.181979 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2e9aed02-01f7-4b3b-9925-241518edf024 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:50.189815 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2e9aed02-01f7-4b3b-9925-241518edf024 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.188660 Jan 11 14:17:50.190378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 421/822] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:49 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:50.329111 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f0866dca-7389-45bd-a3b4-3a1704298a81 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:50.329721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f0866dca-7389-45bd-a3b4-3a1704298a81 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:50.335665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f0866dca-7389-45bd-a3b4-3a1704298a81 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:50.336114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f0866dca-7389-45bd-a3b4-3a1704298a81 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:50.336892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f0866dca-7389-45bd-a3b4-3a1704298a81 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:50.337325 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f0866dca-7389-45bd-a3b4-3a1704298a81 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:50.343949 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:50.344650 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:50.350450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:50.350901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:50.351722 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:50.352163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:50.543165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f0866dca-7389-45bd-a3b4-3a1704298a81 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:50.547637 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:50.550627 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f0866dca-7389-45bd-a3b4-3a1704298a81 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.225074 Jan 11 14:17:50.551200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 402/823] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:50 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:50.555784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:50.557290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:50.558955 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e1a60d11-efd6-45c7-a15e-a13b66409e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.218166 Jan 11 14:17:50.559515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 422/824] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:50 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:51.163893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8ebca113-c19f-4aa4-baad-cf73acaf9d58 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:51.164526 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8ebca113-c19f-4aa4-baad-cf73acaf9d58 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:51.171230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ebca113-c19f-4aa4-baad-cf73acaf9d58 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:51.171707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ebca113-c19f-4aa4-baad-cf73acaf9d58 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:51.172488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ebca113-c19f-4aa4-baad-cf73acaf9d58 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:51.172924 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ebca113-c19f-4aa4-baad-cf73acaf9d58 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:51.206023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4ac85d8f-b19b-4c26-94cb-088c7f92dac9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:51.206540 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4ac85d8f-b19b-4c26-94cb-088c7f92dac9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:51.224658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4ac85d8f-b19b-4c26-94cb-088c7f92dac9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:51.225326 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4ac85d8f-b19b-4c26-94cb-088c7f92dac9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:51.226228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4ac85d8f-b19b-4c26-94cb-088c7f92dac9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:51.226905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4ac85d8f-b19b-4c26-94cb-088c7f92dac9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:51.362163 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8ebca113-c19f-4aa4-baad-cf73acaf9d58 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:51.371800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8ebca113-c19f-4aa4-baad-cf73acaf9d58 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.211417 Jan 11 14:17:51.372387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 403/825] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:51 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:51.406800 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4ac85d8f-b19b-4c26-94cb-088c7f92dac9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:51.414452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4ac85d8f-b19b-4c26-94cb-088c7f92dac9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1358 microversion: 2.1 time: 0.212129 Jan 11 14:17:51.415024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 423/826] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:51 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:51.566883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c9852c35-6da4-4d46-a62f-b184f03cc853 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:51.567533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c9852c35-6da4-4d46-a62f-b184f03cc853 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:51.574693 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c9852c35-6da4-4d46-a62f-b184f03cc853 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:51.575397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c9852c35-6da4-4d46-a62f-b184f03cc853 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:51.576461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c9852c35-6da4-4d46-a62f-b184f03cc853 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:51.577117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c9852c35-6da4-4d46-a62f-b184f03cc853 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:51.580219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:51.580845 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:51.593378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:51.593985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:51.595057 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:51.595731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:51.792341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c9852c35-6da4-4d46-a62f-b184f03cc853 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:51.800445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c9852c35-6da4-4d46-a62f-b184f03cc853 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.237056 Jan 11 14:17:51.801112 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 404/827] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:51 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:51.804135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:51.812011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:51.813500 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:51.814634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-235a0f95-77d6-49a3-aa2c-8577865f9ade tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.241140 Jan 11 14:17:51.815176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 424/828] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:51 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:52.389021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8104d83b-558a-4994-afc3-ae7a168038be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:52.389650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8104d83b-558a-4994-afc3-ae7a168038be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:52.395864 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8104d83b-558a-4994-afc3-ae7a168038be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.396311 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8104d83b-558a-4994-afc3-ae7a168038be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.397084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8104d83b-558a-4994-afc3-ae7a168038be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.397510 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8104d83b-558a-4994-afc3-ae7a168038be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.431302 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-684db7d6-9565-4988-ad6c-8c0e56d470f9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:52.431972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-684db7d6-9565-4988-ad6c-8c0e56d470f9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:52.438253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-684db7d6-9565-4988-ad6c-8c0e56d470f9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.438707 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-684db7d6-9565-4988-ad6c-8c0e56d470f9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.439525 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-684db7d6-9565-4988-ad6c-8c0e56d470f9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.439953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-684db7d6-9565-4988-ad6c-8c0e56d470f9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.581334 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8104d83b-558a-4994-afc3-ae7a168038be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:52.592756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8104d83b-558a-4994-afc3-ae7a168038be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.207286 Jan 11 14:17:52.593320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 405/829] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:52 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:52.618275 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-684db7d6-9565-4988-ad6c-8c0e56d470f9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:52.625616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-684db7d6-9565-4988-ad6c-8c0e56d470f9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1547 microversion: 2.1 time: 0.197930 Jan 11 14:17:52.626186 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 425/830] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:52 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1547 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:52.642407 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-30f3f8d7-1460-4a9a-bd5c-895cfd8246f7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:52.643127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-30f3f8d7-1460-4a9a-bd5c-895cfd8246f7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:52.651521 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-30f3f8d7-1460-4a9a-bd5c-895cfd8246f7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.654361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-30f3f8d7-1460-4a9a-bd5c-895cfd8246f7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.655790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-30f3f8d7-1460-4a9a-bd5c-895cfd8246f7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.656557 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-30f3f8d7-1460-4a9a-bd5c-895cfd8246f7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.814199 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-30f3f8d7-1460-4a9a-bd5c-895cfd8246f7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:52.816851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-95c22d88-63f9-4bf0-87d7-813553f2a4ec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:52.817627 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-95c22d88-63f9-4bf0-87d7-813553f2a4ec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:52.822621 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-30f3f8d7-1460-4a9a-bd5c-895cfd8246f7 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1547 microversion: 2.1 time: 0.184388 Jan 11 14:17:52.823235 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 406/831] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:52 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:52.824403 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-95c22d88-63f9-4bf0-87d7-813553f2a4ec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.825056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-95c22d88-63f9-4bf0-87d7-813553f2a4ec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.826032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-95c22d88-63f9-4bf0-87d7-813553f2a4ec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.826471 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-95c22d88-63f9-4bf0-87d7-813553f2a4ec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.835335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:52.836080 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:52.842396 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.842891 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:52.843788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:52.844255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:53.030293 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-95c22d88-63f9-4bf0-87d7-813553f2a4ec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:53.033719 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:53.037824 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-95c22d88-63f9-4bf0-87d7-813553f2a4ec tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.224629 Jan 11 14:17:53.038405 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 426/832] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:52 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:53.042546 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:53.043696 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:53.044650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:53.045810 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5a662ab2-8a9a-46a6-bde8-e33f47ff67cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.214410 Jan 11 14:17:53.046359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 407/833] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:52 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:53.047089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:17:53.047089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:17:53.048130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:53.048917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Searching by: {'deleted': False, 'project_id': '1d7f551824974a53a1ea507b061f4c72'} {{(pid=116474) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 11 14:17:53.055339 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:53.055824 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:53.056639 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:53.057075 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:53.143612 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.multi_cell_list [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 11 14:17:53.240050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b9c78731-d467-491e-9953-9964f2f68926 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200478 Jan 11 14:17:53.240541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 427/834] 10.222.0.49 () {58 vars in 1124 bytes} [Tue Jan 11 14:17:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:17:53.250411 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9a5f64ea-bb03-4044-a05a-1d2e54f0cb54 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:53.251105 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9a5f64ea-bb03-4044-a05a-1d2e54f0cb54 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:53.256901 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9a5f64ea-bb03-4044-a05a-1d2e54f0cb54 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:53.257415 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9a5f64ea-bb03-4044-a05a-1d2e54f0cb54 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:53.258301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9a5f64ea-bb03-4044-a05a-1d2e54f0cb54 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:53.258718 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9a5f64ea-bb03-4044-a05a-1d2e54f0cb54 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:53.400350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9a5f64ea-bb03-4044-a05a-1d2e54f0cb54 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:53.409361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9a5f64ea-bb03-4044-a05a-1d2e54f0cb54 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1547 microversion: 2.1 time: 0.162512 Jan 11 14:17:53.420360 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 408/835] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:53 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:17:53.610032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f27a85db-c3e1-4bb1-aeb2-c5a1dbc72fc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:53.610861 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f27a85db-c3e1-4bb1-aeb2-c5a1dbc72fc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:53.619627 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f27a85db-c3e1-4bb1-aeb2-c5a1dbc72fc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:53.620325 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f27a85db-c3e1-4bb1-aeb2-c5a1dbc72fc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:53.621431 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f27a85db-c3e1-4bb1-aeb2-c5a1dbc72fc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:53.622086 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f27a85db-c3e1-4bb1-aeb2-c5a1dbc72fc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:53.777442 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f27a85db-c3e1-4bb1-aeb2-c5a1dbc72fc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:53.785292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f27a85db-c3e1-4bb1-aeb2-c5a1dbc72fc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.178991 Jan 11 14:17:53.785860 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 428/836] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:53 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:54.054886 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a8dad3d0-8a7a-4c78-b7ea-e55392bde978 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:54.055520 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a8dad3d0-8a7a-4c78-b7ea-e55392bde978 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:54.061987 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a8dad3d0-8a7a-4c78-b7ea-e55392bde978 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:54.062438 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a8dad3d0-8a7a-4c78-b7ea-e55392bde978 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:54.063223 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a8dad3d0-8a7a-4c78-b7ea-e55392bde978 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:54.063688 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a8dad3d0-8a7a-4c78-b7ea-e55392bde978 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:54.064259 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:54.064871 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:54.070658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:54.071138 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:54.071959 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:54.072397 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:54.257492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a8dad3d0-8a7a-4c78-b7ea-e55392bde978 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:54.261586 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:54.266916 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a8dad3d0-8a7a-4c78-b7ea-e55392bde978 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.215740 Jan 11 14:17:54.267509 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 409/837] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:54 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:54.269299 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:54.270846 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:54.272048 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-edadf298-ee74-4c21-ac02-2ed59df34b8f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.211505 Jan 11 14:17:54.272609 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 429/838] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:54 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:54.802457 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-89c5da15-ad4f-4bb5-a53f-fb346e5af114 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:54.803072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-89c5da15-ad4f-4bb5-a53f-fb346e5af114 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:54.810236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89c5da15-ad4f-4bb5-a53f-fb346e5af114 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:54.810712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89c5da15-ad4f-4bb5-a53f-fb346e5af114 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:54.811518 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89c5da15-ad4f-4bb5-a53f-fb346e5af114 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:54.811977 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89c5da15-ad4f-4bb5-a53f-fb346e5af114 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:54.941473 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-89c5da15-ad4f-4bb5-a53f-fb346e5af114 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:54.949561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-89c5da15-ad4f-4bb5-a53f-fb346e5af114 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.151144 Jan 11 14:17:54.950129 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 410/839] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:54 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:55.283720 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1aed9bd4-00d6-4fae-a7fc-70d0b573edde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:55.284261 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1aed9bd4-00d6-4fae-a7fc-70d0b573edde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:55.289757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:55.290549 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1aed9bd4-00d6-4fae-a7fc-70d0b573edde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:55.290716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:55.291646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1aed9bd4-00d6-4fae-a7fc-70d0b573edde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:55.293019 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1aed9bd4-00d6-4fae-a7fc-70d0b573edde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:55.293477 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1aed9bd4-00d6-4fae-a7fc-70d0b573edde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:55.296785 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:55.297235 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:55.298016 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:55.298453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:55.494937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:55.498428 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1aed9bd4-00d6-4fae-a7fc-70d0b573edde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:55.502806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:55.504367 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:55.505646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1aed9bd4-00d6-4fae-a7fc-70d0b573edde tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.225749 Jan 11 14:17:55.505819 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-76994960-028c-4a30-a666-b2a40bba1041 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.219471 Jan 11 14:17:55.506211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 430/840] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:55 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:55.506634 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 411/841] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:55 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:55.966510 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-04bc67f6-8911-472c-bb17-207091da733b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:55.967067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-04bc67f6-8911-472c-bb17-207091da733b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:55.973009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-04bc67f6-8911-472c-bb17-207091da733b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:55.973484 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-04bc67f6-8911-472c-bb17-207091da733b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:55.974307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-04bc67f6-8911-472c-bb17-207091da733b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:55.974771 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-04bc67f6-8911-472c-bb17-207091da733b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:56.108412 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-04bc67f6-8911-472c-bb17-207091da733b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:56.116184 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-04bc67f6-8911-472c-bb17-207091da733b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.153446 Jan 11 14:17:56.116746 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 431/842] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:55 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:56.521836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fd802e12-1cac-42ca-97f7-b6b852e4aff5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:56.522445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fd802e12-1cac-42ca-97f7-b6b852e4aff5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:56.523540 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:56.524161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:56.529183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fd802e12-1cac-42ca-97f7-b6b852e4aff5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:56.529626 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fd802e12-1cac-42ca-97f7-b6b852e4aff5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:56.530409 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fd802e12-1cac-42ca-97f7-b6b852e4aff5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:56.530845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fd802e12-1cac-42ca-97f7-b6b852e4aff5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:56.530950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:56.531322 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:56.532141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:56.532578 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:56.734881 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fd802e12-1cac-42ca-97f7-b6b852e4aff5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:56.738407 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:56.742289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fd802e12-1cac-42ca-97f7-b6b852e4aff5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.224064 Jan 11 14:17:56.742859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 412/843] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:56 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:56.746966 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:56.748557 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:56.749738 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fefed920-6cb4-42f1-9ffe-b6ece68a3b3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.229803 Jan 11 14:17:56.750288 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 432/844] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:56 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:57.132795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d743204e-3f0c-410b-8203-5afc03d7825a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:57.133327 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d743204e-3f0c-410b-8203-5afc03d7825a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:57.139158 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d743204e-3f0c-410b-8203-5afc03d7825a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:57.139633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d743204e-3f0c-410b-8203-5afc03d7825a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:57.140402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d743204e-3f0c-410b-8203-5afc03d7825a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:57.140834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d743204e-3f0c-410b-8203-5afc03d7825a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:57.275707 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d743204e-3f0c-410b-8203-5afc03d7825a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:57.283376 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d743204e-3f0c-410b-8203-5afc03d7825a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.154278 Jan 11 14:17:57.283970 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 413/845] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:57 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:57.759634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e31fdc93-5741-4442-98c6-6e23785cd0ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:57.760236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e31fdc93-5741-4442-98c6-6e23785cd0ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:57.766501 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e31fdc93-5741-4442-98c6-6e23785cd0ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:57.766948 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e31fdc93-5741-4442-98c6-6e23785cd0ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:57.767553 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:57.767994 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e31fdc93-5741-4442-98c6-6e23785cd0ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:57.768170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:57.768274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e31fdc93-5741-4442-98c6-6e23785cd0ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:57.774303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:57.774749 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:57.775550 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:57.775989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:57.969539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e31fdc93-5741-4442-98c6-6e23785cd0ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:57.977181 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:57.977450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e31fdc93-5741-4442-98c6-6e23785cd0ad tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.221390 Jan 11 14:17:57.978182 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 433/846] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:57 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:57.985521 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:57.987048 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:57.988274 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-edc7f8e0-3c59-4b2f-bd69-6497ac2e4ca4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.224370 Jan 11 14:17:57.988830 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 414/847] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:57 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:17:58.300600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cad66ba5-b8a3-459d-9555-807ec8fd1fdf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:58.301204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cad66ba5-b8a3-459d-9555-807ec8fd1fdf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:58.306898 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cad66ba5-b8a3-459d-9555-807ec8fd1fdf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:58.307365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cad66ba5-b8a3-459d-9555-807ec8fd1fdf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:58.308211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cad66ba5-b8a3-459d-9555-807ec8fd1fdf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:58.308636 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cad66ba5-b8a3-459d-9555-807ec8fd1fdf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:58.439716 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cad66ba5-b8a3-459d-9555-807ec8fd1fdf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:58.447545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cad66ba5-b8a3-459d-9555-807ec8fd1fdf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.150556 Jan 11 14:17:58.448112 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 434/848] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:58 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:58.993726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-93d16e30-22cf-487c-877d-909b7bfea2f0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:58.994375 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-93d16e30-22cf-487c-877d-909b7bfea2f0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:59.000713 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-93d16e30-22cf-487c-877d-909b7bfea2f0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:59.001267 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-93d16e30-22cf-487c-877d-909b7bfea2f0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:59.002062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-93d16e30-22cf-487c-877d-909b7bfea2f0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:59.002532 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-93d16e30-22cf-487c-877d-909b7bfea2f0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:59.007417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:59.007417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:59.013105 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:59.013457 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:59.014244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:59.015166 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:59.137029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-93d16e30-22cf-487c-877d-909b7bfea2f0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:59.144200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-93d16e30-22cf-487c-877d-909b7bfea2f0 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.154080 Jan 11 14:17:59.144768 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 415/849] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:58 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:17:59.330753 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:59.338804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:59.340913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:59.342056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-316413cc-96d3-43d1-b751-3fefa348c548 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.339770 Jan 11 14:17:59.342607 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 435/850] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:17:59 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:17:59.464039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dc89fbbb-0d3e-4858-bc2c-20ab1059b933 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:17:59.465250 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dc89fbbb-0d3e-4858-bc2c-20ab1059b933 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:17:59.471120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dc89fbbb-0d3e-4858-bc2c-20ab1059b933 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:59.471604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dc89fbbb-0d3e-4858-bc2c-20ab1059b933 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:59.472393 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dc89fbbb-0d3e-4858-bc2c-20ab1059b933 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:17:59.472827 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dc89fbbb-0d3e-4858-bc2c-20ab1059b933 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:17:59.606584 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dc89fbbb-0d3e-4858-bc2c-20ab1059b933 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:17:59.615390 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dc89fbbb-0d3e-4858-bc2c-20ab1059b933 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.154991 Jan 11 14:17:59.615995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 416/851] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:17:59 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:00.161221 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e68cd96c-117c-417a-971b-857c962d89bf tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:00.162306 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e68cd96c-117c-417a-971b-857c962d89bf tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:00.168793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e68cd96c-117c-417a-971b-857c962d89bf tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:00.169249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e68cd96c-117c-417a-971b-857c962d89bf tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:00.170045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e68cd96c-117c-417a-971b-857c962d89bf tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:00.170486 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e68cd96c-117c-417a-971b-857c962d89bf tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:00.280762 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-3db4be35-c593-47e5-86c0-ec8be5f1e9b1 req-f068f84e-4add-4e05-822c-129c635f1bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c7cf3b-e6db-481d-a653-c246c1a5559a", "name": "network-vif-unplugged", "status": "completed", "tag": "fc42310a-f7c1-4855-943b-ce524357db67"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:00.282369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:00.282369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:18:00.295246 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-3db4be35-c593-47e5-86c0-ec8be5f1e9b1 req-f068f84e-4add-4e05-822c-129c635f1bb3 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:00.296163 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-3db4be35-c593-47e5-86c0-ec8be5f1e9b1 req-f068f84e-4add-4e05-822c-129c635f1bb3 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:00.316030 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-3db4be35-c593-47e5-86c0-ec8be5f1e9b1 req-f068f84e-4add-4e05-822c-129c635f1bb3 service nova] Creating event network-vif-unplugged:fc42310a-f7c1-4855-943b-ce524357db67 for instance 15c7cf3b-e6db-481d-a653-c246c1a5559a on hv-cinder-82413 Jan 11 14:18:00.321278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-3db4be35-c593-47e5-86c0-ec8be5f1e9b1 req-f068f84e-4add-4e05-822c-129c635f1bb3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047171 Jan 11 14:18:00.322234 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 417/852] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:00.362183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:00.363769 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:00.372133 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:00.372585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:00.373842 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:00.374287 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:00.399851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e68cd96c-117c-417a-971b-857c962d89bf tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:00.411264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e68cd96c-117c-417a-971b-857c962d89bf tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1513 microversion: 2.1 time: 0.253779 Jan 11 14:18:00.421249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 436/853] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:00 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:00.619446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:00.628307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:00.629824 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:00.630983 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b7e28265-3fb3-424e-b2b7-91c647c6d0af tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.273543 Jan 11 14:18:00.633020 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f0ae948d-61b8-44f7-94ba-1333abc82448 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:00.634054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f0ae948d-61b8-44f7-94ba-1333abc82448 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:00.640791 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f0ae948d-61b8-44f7-94ba-1333abc82448 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:00.641247 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f0ae948d-61b8-44f7-94ba-1333abc82448 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:00.642033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f0ae948d-61b8-44f7-94ba-1333abc82448 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:00.642441 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 418/854] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:00 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:00.642657 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f0ae948d-61b8-44f7-94ba-1333abc82448 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:00.792951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-ad730e41-6041-4ace-9e4d-9d65fe781a71 req-0b68d48b-9da0-419e-ac3d-2491589d9881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c7cf3b-e6db-481d-a653-c246c1a5559a", "name": "network-vif-deleted", "tag": "fc42310a-f7c1-4855-943b-ce524357db67"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:00.795702 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:00.795702 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:18:00.804681 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-ad730e41-6041-4ace-9e4d-9d65fe781a71 req-0b68d48b-9da0-419e-ac3d-2491589d9881 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:00.805136 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-ad730e41-6041-4ace-9e4d-9d65fe781a71 req-0b68d48b-9da0-419e-ac3d-2491589d9881 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:00.817892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-ad730e41-6041-4ace-9e4d-9d65fe781a71 req-0b68d48b-9da0-419e-ac3d-2491589d9881 service nova] Creating event network-vif-deleted:fc42310a-f7c1-4855-943b-ce524357db67 for instance 15c7cf3b-e6db-481d-a653-c246c1a5559a on hv-cinder-82413 Jan 11 14:18:00.822758 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-ad730e41-6041-4ace-9e4d-9d65fe781a71 req-0b68d48b-9da0-419e-ac3d-2491589d9881 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034498 Jan 11 14:18:00.824540 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 419/855] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:18:00.858346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f0ae948d-61b8-44f7-94ba-1333abc82448 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:00.868457 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f0ae948d-61b8-44f7-94ba-1333abc82448 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.239246 Jan 11 14:18:00.869095 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 437/856] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:00 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:01.428360 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:01.429054 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:01.435915 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:01.436364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:01.437143 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:01.437580 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:01.469240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:01.469686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:01.470131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lazy-loading 'fault' on Instance uuid 15c7cf3b-e6db-481d-a653-c246c1a5559a {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:18:01.508252 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:01.515442 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cd4ba237-df50-4ca5-913c-02c1bb4daf1c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 200 len: 1307 microversion: 2.1 time: 0.091043 Jan 11 14:18:01.515997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 420/857] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:01 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:01.649794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:01.650187 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:01.656987 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:01.657432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:01.658219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:01.658657 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:01.796337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:01.804167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:01.805688 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:01.806831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4a7a34d5-1d9d-4231-a47c-9e4b67179c68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.161183 Jan 11 14:18:01.807389 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 438/858] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:01 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:01.885773 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d3f6a73f-e7d1-409e-ac16-e80a33eccb4b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:01.886383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d3f6a73f-e7d1-409e-ac16-e80a33eccb4b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:01.892259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3f6a73f-e7d1-409e-ac16-e80a33eccb4b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:01.892711 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3f6a73f-e7d1-409e-ac16-e80a33eccb4b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:01.893493 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3f6a73f-e7d1-409e-ac16-e80a33eccb4b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:01.893927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3f6a73f-e7d1-409e-ac16-e80a33eccb4b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:02.025822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d3f6a73f-e7d1-409e-ac16-e80a33eccb4b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:02.034447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d3f6a73f-e7d1-409e-ac16-e80a33eccb4b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.152248 Jan 11 14:18:02.035029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 421/859] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:01 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:02.343981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-a5c894f3-5e2e-4900-a416-d0c0c46e40e9 req-d0d9c77b-c68a-4474-a5ad-cb0e0a42149c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07361687-ec7a-4f6e-8e42-530c1a64ba04", "name": "network-vif-plugged", "status": "completed", "tag": "c51643c6-7fc4-41fe-bb8c-e237ddadcdaf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:02.355830 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:02.355830 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:18:02.362143 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7396e9c0-687e-4f9e-b07f-aa0937292906 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e932d8c1-a320-4cd4-aa49-babacc2dac6a"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:02.363174 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-a5c894f3-5e2e-4900-a416-d0c0c46e40e9 req-d0d9c77b-c68a-4474-a5ad-cb0e0a42149c service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:02.363293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7396e9c0-687e-4f9e-b07f-aa0937292906 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:02.363657 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-a5c894f3-5e2e-4900-a416-d0c0c46e40e9 req-d0d9c77b-c68a-4474-a5ad-cb0e0a42149c service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:02.378180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-a5c894f3-5e2e-4900-a416-d0c0c46e40e9 req-d0d9c77b-c68a-4474-a5ad-cb0e0a42149c service nova] Creating event network-vif-plugged:c51643c6-7fc4-41fe-bb8c-e237ddadcdaf for instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 on hv-cinder-82413 Jan 11 14:18:02.385962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7396e9c0-687e-4f9e-b07f-aa0937292906 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:02.385962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7396e9c0-687e-4f9e-b07f-aa0937292906 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:02.385962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7396e9c0-687e-4f9e-b07f-aa0937292906 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:02.386207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7396e9c0-687e-4f9e-b07f-aa0937292906 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:02.392984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-a5c894f3-5e2e-4900-a416-d0c0c46e40e9 req-d0d9c77b-c68a-4474-a5ad-cb0e0a42149c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057951 Jan 11 14:18:02.393974 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 439/860] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:02.534063 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:02.534844 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 15c7cf3b-e6db-481d-a653-c246c1a5559a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:02.541361 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:02.541815 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:02.543122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:02.543593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:02.558907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] HTTP exception thrown: Instance 15c7cf3b-e6db-481d-a653-c246c1a5559a could not be found. Jan 11 14:18:02.559403 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Returning 404 to user: Instance 15c7cf3b-e6db-481d-a653-c246c1a5559a could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:18:02.560253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1c51240e-cbd9-4cf2-97ff-064ef3c3ad47 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a" status: 404 len: 111 microversion: 2.1 time: 0.032610 Jan 11 14:18:02.561314 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 440/861] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:02 2022] GET /compute/v2.1/servers/15c7cf3b-e6db-481d-a653-c246c1a5559a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 14:18:02.735883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7396e9c0-687e-4f9e-b07f-aa0937292906 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "POST /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377161 Jan 11 14:18:02.736502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 422/862] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:18:02 2022] POST /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:18:02.826160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:02.826775 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:02.832948 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:02.833470 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:02.834352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:02.834947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:02.968480 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:02.976383 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:02.977905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:02.979055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-caa2e707-aef3-45c4-af9b-d622dc8ad184 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1741 microversion: 2.20 time: 0.157457 Jan 11 14:18:02.979635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 441/863] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:02 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:03.052950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cf4c4699-a4a7-4785-a7e5-a38962d0e4f1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:03.053955 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cf4c4699-a4a7-4785-a7e5-a38962d0e4f1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:03.060943 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cf4c4699-a4a7-4785-a7e5-a38962d0e4f1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:03.061391 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cf4c4699-a4a7-4785-a7e5-a38962d0e4f1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:03.062516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cf4c4699-a4a7-4785-a7e5-a38962d0e4f1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:03.063049 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cf4c4699-a4a7-4785-a7e5-a38962d0e4f1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:03.196407 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cf4c4699-a4a7-4785-a7e5-a38962d0e4f1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:03.204389 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cf4c4699-a4a7-4785-a7e5-a38962d0e4f1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.155839 Jan 11 14:18:03.204954 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 423/864] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:03 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:03.999659 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:04.000357 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:04.012750 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:04.013947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:04.014835 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:04.019410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:04.222788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c2a36551-f79e-49f8-9e79-3fa918868068 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:04.223673 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c2a36551-f79e-49f8-9e79-3fa918868068 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:04.238127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c2a36551-f79e-49f8-9e79-3fa918868068 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:04.238495 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c2a36551-f79e-49f8-9e79-3fa918868068 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:04.239545 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c2a36551-f79e-49f8-9e79-3fa918868068 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:04.239790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c2a36551-f79e-49f8-9e79-3fa918868068 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:04.536888 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:04.546071 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:04.549592 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:04.551196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-22365614-9c0a-486a-8be1-f12e1d3a814a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.557315 Jan 11 14:18:04.552012 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 442/865] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:03 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:04.643178 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c2a36551-f79e-49f8-9e79-3fa918868068 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:04.656113 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c2a36551-f79e-49f8-9e79-3fa918868068 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.437453 Jan 11 14:18:04.657804 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 424/866] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:04 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:18:04.806705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3a82e1a1-ece3-4085-84ea-715671ae1269 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:04.808940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3a82e1a1-ece3-4085-84ea-715671ae1269 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:04.821283 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3a82e1a1-ece3-4085-84ea-715671ae1269 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:04.821736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3a82e1a1-ece3-4085-84ea-715671ae1269 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:04.822548 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3a82e1a1-ece3-4085-84ea-715671ae1269 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:04.822973 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3a82e1a1-ece3-4085-84ea-715671ae1269 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:04.866620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3a82e1a1-ece3-4085-84ea-715671ae1269 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:18:04.958253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3a82e1a1-ece3-4085-84ea-715671ae1269 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "DELETE /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 204 len: 0 microversion: 2.1 time: 0.156252 Jan 11 14:18:04.958939 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 443/867] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:18:04 2022] DELETE /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:18:04.967478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b91691ba-e3d0-4d4e-86e0-b631b36b5173 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:04.968116 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b91691ba-e3d0-4d4e-86e0-b631b36b5173 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:04.976091 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b91691ba-e3d0-4d4e-86e0-b631b36b5173 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:04.977185 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b91691ba-e3d0-4d4e-86e0-b631b36b5173 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:04.978254 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b91691ba-e3d0-4d4e-86e0-b631b36b5173 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:04.978845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b91691ba-e3d0-4d4e-86e0-b631b36b5173 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:05.129022 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b91691ba-e3d0-4d4e-86e0-b631b36b5173 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:05.140113 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b91691ba-e3d0-4d4e-86e0-b631b36b5173 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1515 microversion: 2.1 time: 0.176696 Jan 11 14:18:05.141393 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 425/868] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:04 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:05.571207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:05.571936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:05.579841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:05.580295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:05.581091 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:05.581533 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:05.742286 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:05.759051 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:05.760598 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:05.762416 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e7ddd272-91dd-48b4-a209-21ee27492076 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.195433 Jan 11 14:18:05.762984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 444/869] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:05 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:18:05.796672 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6296ca92-fad6-4c10-8ccd-50d7691cfe7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:05.797453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6296ca92-fad6-4c10-8ccd-50d7691cfe7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:05.805927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6296ca92-fad6-4c10-8ccd-50d7691cfe7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:05.806380 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6296ca92-fad6-4c10-8ccd-50d7691cfe7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:05.807175 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6296ca92-fad6-4c10-8ccd-50d7691cfe7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:05.808232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6296ca92-fad6-4c10-8ccd-50d7691cfe7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:06.026178 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6296ca92-fad6-4c10-8ccd-50d7691cfe7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:06.036653 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6296ca92-fad6-4c10-8ccd-50d7691cfe7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.369516 Jan 11 14:18:06.037516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 426/870] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:05 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:18:06.158224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-66f8a8cf-54fc-4c2a-8edb-2305a1b3f894 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:06.158840 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-66f8a8cf-54fc-4c2a-8edb-2305a1b3f894 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:06.168438 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-66f8a8cf-54fc-4c2a-8edb-2305a1b3f894 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:06.168938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-66f8a8cf-54fc-4c2a-8edb-2305a1b3f894 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:06.170624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-66f8a8cf-54fc-4c2a-8edb-2305a1b3f894 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:06.171010 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-66f8a8cf-54fc-4c2a-8edb-2305a1b3f894 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:06.326037 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-66f8a8cf-54fc-4c2a-8edb-2305a1b3f894 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:06.334065 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-66f8a8cf-54fc-4c2a-8edb-2305a1b3f894 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1515 microversion: 2.1 time: 0.180250 Jan 11 14:18:06.334645 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 445/871] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:06 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:06.581399 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:18:06.582404 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:18:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:18:06.782223 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:06.782833 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:06.788961 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:06.789412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:06.790196 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:06.790632 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:06.955487 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:06.963768 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:06.966568 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:06.967984 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ff2b1a07-696f-4070-aabb-e5998625e465 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.189864 Jan 11 14:18:06.968875 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 427/872] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:06 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:18:07.057103 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6e730fbb-7c87-494f-b8c4-5dbfb0ac869e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:07.058732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6e730fbb-7c87-494f-b8c4-5dbfb0ac869e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:07.075965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e730fbb-7c87-494f-b8c4-5dbfb0ac869e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:07.075965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e730fbb-7c87-494f-b8c4-5dbfb0ac869e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:07.075965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e730fbb-7c87-494f-b8c4-5dbfb0ac869e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:07.075965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e730fbb-7c87-494f-b8c4-5dbfb0ac869e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:07.242333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6e730fbb-7c87-494f-b8c4-5dbfb0ac869e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:07.250549 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6e730fbb-7c87-494f-b8c4-5dbfb0ac869e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.197859 Jan 11 14:18:07.251110 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 446/873] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:07 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:07.351957 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b18e31a4-f9f2-4f4b-ab97-bf6c327bdc9c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:07.352887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b18e31a4-f9f2-4f4b-ab97-bf6c327bdc9c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:07.360106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b18e31a4-f9f2-4f4b-ab97-bf6c327bdc9c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:07.360799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b18e31a4-f9f2-4f4b-ab97-bf6c327bdc9c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:07.361770 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b18e31a4-f9f2-4f4b-ab97-bf6c327bdc9c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:07.362381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b18e31a4-f9f2-4f4b-ab97-bf6c327bdc9c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:07.507646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b18e31a4-f9f2-4f4b-ab97-bf6c327bdc9c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:07.515354 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b18e31a4-f9f2-4f4b-ab97-bf6c327bdc9c tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1515 microversion: 2.1 time: 0.167091 Jan 11 14:18:07.515962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 428/874] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:07 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:07.986385 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:07.987665 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:07.994079 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:07.994526 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:07.995877 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:07.996311 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:08.147648 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:08.155886 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:08.157421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:08.158578 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-94aaf697-4c18-42db-868e-be07a4b15239 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.176301 Jan 11 14:18:08.159133 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 447/875] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:07 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:08.268076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3ba4185b-cb5d-482c-b4ff-e2af541c8ac1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:08.268612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3ba4185b-cb5d-482c-b4ff-e2af541c8ac1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:08.274767 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ba4185b-cb5d-482c-b4ff-e2af541c8ac1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:08.275232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ba4185b-cb5d-482c-b4ff-e2af541c8ac1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:08.276057 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ba4185b-cb5d-482c-b4ff-e2af541c8ac1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:08.276538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3ba4185b-cb5d-482c-b4ff-e2af541c8ac1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:08.422943 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3ba4185b-cb5d-482c-b4ff-e2af541c8ac1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:08.431761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3ba4185b-cb5d-482c-b4ff-e2af541c8ac1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1723 microversion: 2.1 time: 0.167805 Jan 11 14:18:08.442166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 429/876] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:08 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:08.532484 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-875f5c91-11c7-4dbd-9683-f2b4f5b13d71 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:08.533333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-875f5c91-11c7-4dbd-9683-f2b4f5b13d71 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:08.540241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-875f5c91-11c7-4dbd-9683-f2b4f5b13d71 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:08.544172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-875f5c91-11c7-4dbd-9683-f2b4f5b13d71 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:08.545024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-875f5c91-11c7-4dbd-9683-f2b4f5b13d71 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:08.545471 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-875f5c91-11c7-4dbd-9683-f2b4f5b13d71 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:08.692647 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-875f5c91-11c7-4dbd-9683-f2b4f5b13d71 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:08.709722 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-875f5c91-11c7-4dbd-9683-f2b4f5b13d71 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1515 microversion: 2.1 time: 0.181015 Jan 11 14:18:08.710531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 448/877] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:08 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:09.178163 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:09.180262 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:09.185787 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.186354 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:09.187200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.187670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:09.366650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:09.376508 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:09.378455 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:09.379880 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7795e8af-2ff8-4d5b-8f28-4f5f505ca70a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.205499 Jan 11 14:18:09.380659 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 430/878] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:09 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:09.450313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c5b56680-23b4-41db-9990-57ff6ea1b96d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:09.451676 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c5b56680-23b4-41db-9990-57ff6ea1b96d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:09.457844 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c5b56680-23b4-41db-9990-57ff6ea1b96d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.458388 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c5b56680-23b4-41db-9990-57ff6ea1b96d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:09.459392 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c5b56680-23b4-41db-9990-57ff6ea1b96d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.460061 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c5b56680-23b4-41db-9990-57ff6ea1b96d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:09.624818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c5b56680-23b4-41db-9990-57ff6ea1b96d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:09.637447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c5b56680-23b4-41db-9990-57ff6ea1b96d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1700 microversion: 2.1 time: 0.190003 Jan 11 14:18:09.649799 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 449/879] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:09 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1700 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:09.654370 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-947a0411-c0ab-4a99-8477-a92ea19ec639 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:09.660847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-947a0411-c0ab-4a99-8477-a92ea19ec639 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.661324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-947a0411-c0ab-4a99-8477-a92ea19ec639 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:09.693184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-947a0411-c0ab-4a99-8477-a92ea19ec639 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Going to try to start instance {{(pid=116475) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 11 14:18:09.726117 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2e21b1c1-9487-47a5-b116-d18e468538ea tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:09.727208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2e21b1c1-9487-47a5-b116-d18e468538ea tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:09.734784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2e21b1c1-9487-47a5-b116-d18e468538ea tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.735483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2e21b1c1-9487-47a5-b116-d18e468538ea tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:09.736359 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2e21b1c1-9487-47a5-b116-d18e468538ea tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.737768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2e21b1c1-9487-47a5-b116-d18e468538ea tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:09.814919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-947a0411-c0ab-4a99-8477-a92ea19ec639 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 202 len: 0 microversion: 2.1 time: 0.163949 Jan 11 14:18:09.815446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 431/880] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:18:09 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:18:09.831527 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1dcc324f-caca-4690-9019-3f956787bdf8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:09.831527 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1dcc324f-caca-4690-9019-3f956787bdf8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:09.831885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1dcc324f-caca-4690-9019-3f956787bdf8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.832209 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1dcc324f-caca-4690-9019-3f956787bdf8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:09.833012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1dcc324f-caca-4690-9019-3f956787bdf8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:09.833453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1dcc324f-caca-4690-9019-3f956787bdf8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:10.022137 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1dcc324f-caca-4690-9019-3f956787bdf8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:10.026019 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2e21b1c1-9487-47a5-b116-d18e468538ea tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:10.033630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2e21b1c1-9487-47a5-b116-d18e468538ea tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1515 microversion: 2.1 time: 0.311344 Jan 11 14:18:10.034050 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1dcc324f-caca-4690-9019-3f956787bdf8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1709 microversion: 2.1 time: 0.213962 Jan 11 14:18:10.043330 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 450/881] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:09 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1515 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:18:10.044649 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 432/882] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:09 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1709 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:10.554209 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:10.556020 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:10.565780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:10.567006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:10.568486 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:10.569072 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:10.810422 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:10.820210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:10.821776 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:10.822925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-53faabe5-afa1-464b-9eb2-176f818d3560 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.428694 Jan 11 14:18:10.834209 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 451/883] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:10 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:11.051035 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f4e65f64-fda2-43fe-b689-f53152725de9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:11.052224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f4e65f64-fda2-43fe-b689-f53152725de9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:11.061630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f8dce108-312d-4fc0-bd98-e6ba928fd6b8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:11.063014 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f8dce108-312d-4fc0-bd98-e6ba928fd6b8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:11.071414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8dce108-312d-4fc0-bd98-e6ba928fd6b8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:11.071920 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8dce108-312d-4fc0-bd98-e6ba928fd6b8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:11.080582 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4e65f64-fda2-43fe-b689-f53152725de9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:11.081291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4e65f64-fda2-43fe-b689-f53152725de9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:11.082493 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8dce108-312d-4fc0-bd98-e6ba928fd6b8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:11.083081 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8dce108-312d-4fc0-bd98-e6ba928fd6b8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:11.083387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4e65f64-fda2-43fe-b689-f53152725de9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:11.083860 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4e65f64-fda2-43fe-b689-f53152725de9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:11.349677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f8dce108-312d-4fc0-bd98-e6ba928fd6b8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:11.359784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f8dce108-312d-4fc0-bd98-e6ba928fd6b8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1709 microversion: 2.1 time: 0.302315 Jan 11 14:18:11.360666 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 452/884] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:11 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1709 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:11.367219 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f4e65f64-fda2-43fe-b689-f53152725de9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:11.377942 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f4e65f64-fda2-43fe-b689-f53152725de9 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1515 microversion: 2.1 time: 0.331209 Jan 11 14:18:11.379245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 433/885] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:11 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:11.843465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:11.844860 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:11.853828 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:11.854656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:11.855775 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:11.857882 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:12.020445 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:12.030233 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:12.031920 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:12.033150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1c6288fc-306f-45b8-9bbd-70d643139af2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.195419 Jan 11 14:18:12.034211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 453/886] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:11 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:18:12.377186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8f86d84c-f1a4-4758-9c6b-b0b4e30a0382 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:12.378619 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8f86d84c-f1a4-4758-9c6b-b0b4e30a0382 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:12.385910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f86d84c-f1a4-4758-9c6b-b0b4e30a0382 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:12.386612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f86d84c-f1a4-4758-9c6b-b0b4e30a0382 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:12.387614 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f86d84c-f1a4-4758-9c6b-b0b4e30a0382 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:12.388597 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8f86d84c-f1a4-4758-9c6b-b0b4e30a0382 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:12.395452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6700e5e3-9310-4aff-8a20-0fe889e323f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:12.404006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6700e5e3-9310-4aff-8a20-0fe889e323f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:12.412282 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6700e5e3-9310-4aff-8a20-0fe889e323f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:12.415154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6700e5e3-9310-4aff-8a20-0fe889e323f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:12.416196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6700e5e3-9310-4aff-8a20-0fe889e323f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:12.418605 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6700e5e3-9310-4aff-8a20-0fe889e323f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:12.749324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6700e5e3-9310-4aff-8a20-0fe889e323f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:12.757739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6700e5e3-9310-4aff-8a20-0fe889e323f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 200 len: 1515 microversion: 2.1 time: 0.365848 Jan 11 14:18:12.758309 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 454/887] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:12 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:12.771165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8f86d84c-f1a4-4758-9c6b-b0b4e30a0382 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:12.779961 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8f86d84c-f1a4-4758-9c6b-b0b4e30a0382 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1713 microversion: 2.1 time: 0.406318 Jan 11 14:18:12.792016 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 434/888] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:12 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1713 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:18:12.956133 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-89b4a32d-5060-4b4d-bc56-2bede8112968 req-5199e299-dff7-4c1f-9720-335e9cb67510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72dedc58-795a-45be-946e-b22d685ee6c1", "name": "network-vif-deleted", "tag": "097e8414-4883-4986-ba49-5f760c6cbef9"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:12.958346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:12.958346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:18:12.974024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-89b4a32d-5060-4b4d-bc56-2bede8112968 req-5199e299-dff7-4c1f-9720-335e9cb67510 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:12.974693 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-89b4a32d-5060-4b4d-bc56-2bede8112968 req-5199e299-dff7-4c1f-9720-335e9cb67510 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:12.991408 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-89b4a32d-5060-4b4d-bc56-2bede8112968 req-5199e299-dff7-4c1f-9720-335e9cb67510 service nova] Creating event network-vif-deleted:097e8414-4883-4986-ba49-5f760c6cbef9 for instance 72dedc58-795a-45be-946e-b22d685ee6c1 on hv-cinder-82413 Jan 11 14:18:12.997858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-89b4a32d-5060-4b4d-bc56-2bede8112968 req-5199e299-dff7-4c1f-9720-335e9cb67510 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045451 Jan 11 14:18:13.003030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 455/889] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:13.055652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:13.057036 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:13.067326 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:13.068845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:13.070086 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:13.070715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:13.335632 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:13.347807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:13.350515 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:13.351862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3aeb65a2-3f98-4ad1-8089-4ec998c86039 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.303483 Jan 11 14:18:13.352817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 435/890] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:13 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:13.778099 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:13.778972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 72dedc58-795a-45be-946e-b22d685ee6c1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:13.785282 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:13.785994 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:13.786821 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:13.787259 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:13.803957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] HTTP exception thrown: Instance 72dedc58-795a-45be-946e-b22d685ee6c1 could not be found. Jan 11 14:18:13.804857 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Returning 404 to user: Instance 72dedc58-795a-45be-946e-b22d685ee6c1 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:18:13.806028 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f2a90068-e242-4ceb-875b-cd6fb5bb2e20 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1" status: 404 len: 111 microversion: 2.1 time: 0.033232 Jan 11 14:18:13.806751 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 456/891] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:13 2022] GET /compute/v2.1/servers/72dedc58-795a-45be-946e-b22d685ee6c1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:18:13.815724 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3efe7428-22f1-417a-9150-5433a976efcc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:13.817561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3efe7428-22f1-417a-9150-5433a976efcc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:13.827026 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3efe7428-22f1-417a-9150-5433a976efcc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:13.827596 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3efe7428-22f1-417a-9150-5433a976efcc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:13.828506 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3efe7428-22f1-417a-9150-5433a976efcc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:13.828959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3efe7428-22f1-417a-9150-5433a976efcc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:13.861391 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3efe7428-22f1-417a-9150-5433a976efcc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Going to try to terminate instance {{(pid=116475) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:18:13.954221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3efe7428-22f1-417a-9150-5433a976efcc tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "DELETE /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 204 len: 0 microversion: 2.1 time: 0.142958 Jan 11 14:18:13.954977 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 436/892] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:18:13 2022] DELETE /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:18:13.962887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c0d4fe68-f603-4837-aa91-42d94b9052cb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:13.963429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c0d4fe68-f603-4837-aa91-42d94b9052cb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:13.970879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c0d4fe68-f603-4837-aa91-42d94b9052cb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:13.976135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c0d4fe68-f603-4837-aa91-42d94b9052cb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:13.976965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c0d4fe68-f603-4837-aa91-42d94b9052cb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:13.977727 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c0d4fe68-f603-4837-aa91-42d94b9052cb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:14.116606 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c0d4fe68-f603-4837-aa91-42d94b9052cb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:14.124557 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c0d4fe68-f603-4837-aa91-42d94b9052cb tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1513 microversion: 2.1 time: 0.165499 Jan 11 14:18:14.125332 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 457/893] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:13 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:18:14.371124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:14.371763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:14.377631 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:14.378075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:14.378851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:14.379287 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:14.515132 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:14.523434 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:14.525043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:14.527256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7a7f2fd2-6b22-40b1-8a76-110143244b98 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1736 microversion: 2.20 time: 0.159438 Jan 11 14:18:14.527256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 437/894] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:14 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:15.142646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e8238a26-7b91-4839-8cbd-cfa5011cd744 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:15.143260 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e8238a26-7b91-4839-8cbd-cfa5011cd744 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:15.149475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8238a26-7b91-4839-8cbd-cfa5011cd744 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:15.149925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8238a26-7b91-4839-8cbd-cfa5011cd744 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:15.150746 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8238a26-7b91-4839-8cbd-cfa5011cd744 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:15.151218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e8238a26-7b91-4839-8cbd-cfa5011cd744 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:15.415308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e8238a26-7b91-4839-8cbd-cfa5011cd744 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:15.423346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e8238a26-7b91-4839-8cbd-cfa5011cd744 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1513 microversion: 2.1 time: 0.284877 Jan 11 14:18:15.423930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 458/895] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:15 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:15.544021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:15.544633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:15.550862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:15.551318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:15.552164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:15.552603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:15.699636 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:15.709068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:15.710718 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:15.711898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8c569dfb-8375-4136-bf25-b43a65ea4a60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1718 microversion: 2.20 time: 0.171602 Jan 11 14:18:15.712456 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 438/896] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:15 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:16.440674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b82914f3-fb65-4344-896e-48b71145b821 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:16.441849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b82914f3-fb65-4344-896e-48b71145b821 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:16.449978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b82914f3-fb65-4344-896e-48b71145b821 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:16.450420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b82914f3-fb65-4344-896e-48b71145b821 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:16.451435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b82914f3-fb65-4344-896e-48b71145b821 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:16.452068 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b82914f3-fb65-4344-896e-48b71145b821 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:16.653881 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b82914f3-fb65-4344-896e-48b71145b821 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:16.661646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b82914f3-fb65-4344-896e-48b71145b821 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 200 len: 1513 microversion: 2.1 time: 0.225348 Jan 11 14:18:16.662144 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 459/897] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:16 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:16.732583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:16.736517 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:16.752189 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:16.752997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:16.754495 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:16.755157 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:16.841693 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-00b438e9-dbcf-4dd7-bcc8-e529e6976902 req-2f2931cd-f6b1-44cd-a087-908e8387a9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57149afd-9a49-4af4-8197-c218a8c0846c", "name": "network-vif-deleted", "tag": "16deb647-6c63-414a-a191-4b93e1d0501e"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:16.855413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:16.855413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:18:16.872719 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-00b438e9-dbcf-4dd7-bcc8-e529e6976902 req-2f2931cd-f6b1-44cd-a087-908e8387a9be service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:16.873943 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-00b438e9-dbcf-4dd7-bcc8-e529e6976902 req-2f2931cd-f6b1-44cd-a087-908e8387a9be service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:16.921874 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-00b438e9-dbcf-4dd7-bcc8-e529e6976902 req-2f2931cd-f6b1-44cd-a087-908e8387a9be service nova] Creating event network-vif-deleted:16deb647-6c63-414a-a191-4b93e1d0501e for instance 57149afd-9a49-4af4-8197-c218a8c0846c on hv-cinder-82413 Jan 11 14:18:16.935347 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-00b438e9-dbcf-4dd7-bcc8-e529e6976902 req-2f2931cd-f6b1-44cd-a087-908e8387a9be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099200 Jan 11 14:18:16.936933 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 460/898] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:18:16.993620 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:17.004070 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:17.014868 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:17.017293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ac87217c-2b83-4f72-bc61-4fda81a0aea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1718 microversion: 2.20 time: 0.289595 Jan 11 14:18:17.018528 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 439/899] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:16 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1718 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:17.681081 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:17.682318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: 57149afd-9a49-4af4-8197-c218a8c0846c] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:17.689294 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:17.689822 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:17.690684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:17.691187 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:17.705466 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] HTTP exception thrown: Instance 57149afd-9a49-4af4-8197-c218a8c0846c could not be found. Jan 11 14:18:17.706063 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Returning 404 to user: Instance 57149afd-9a49-4af4-8197-c218a8c0846c could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:18:17.706887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ab6d334f-a766-4ee7-90eb-3e3704cb3223 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c" status: 404 len: 111 microversion: 2.1 time: 0.030719 Jan 11 14:18:17.707440 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 461/900] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:17 2022] GET /compute/v2.1/servers/57149afd-9a49-4af4-8197-c218a8c0846c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:18:17.941279 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ac7cc4fa-0811-4937-9627-b778dc33a780 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:17.942030 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ac7cc4fa-0811-4937-9627-b778dc33a780 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:17.948369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac7cc4fa-0811-4937-9627-b778dc33a780 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:17.948865 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac7cc4fa-0811-4937-9627-b778dc33a780 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:17.949981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac7cc4fa-0811-4937-9627-b778dc33a780 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:17.950471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac7cc4fa-0811-4937-9627-b778dc33a780 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:18.038191 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:18.039030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:18.049298 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:18.050086 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:18.050959 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:18.052232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:18.138144 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ac7cc4fa-0811-4937-9627-b778dc33a780 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:18.158843 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ac7cc4fa-0811-4937-9627-b778dc33a780 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1593 microversion: 2.1 time: 0.220610 Jan 11 14:18:18.160011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 440/901] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:17 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1593 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:18.234030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:18.243000 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:18.244719 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:18.246737 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fd32ebe0-088d-4ee1-860a-3727692c3e6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1718 microversion: 2.20 time: 0.213550 Jan 11 14:18:18.257753 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 462/902] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:18 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1718 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:18.335311 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-1e210ae8-bba0-4c59-8b3d-97f5000b1d26 req-20204ce3-31df-45f1-a2c3-2e9e673c98d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07361687-ec7a-4f6e-8e42-530c1a64ba04", "name": "network-vif-unplugged", "status": "completed", "tag": "c51643c6-7fc4-41fe-bb8c-e237ddadcdaf"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:18.339014 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:18.339014 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:18:18.350505 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-1e210ae8-bba0-4c59-8b3d-97f5000b1d26 req-20204ce3-31df-45f1-a2c3-2e9e673c98d0 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:18.351346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-1e210ae8-bba0-4c59-8b3d-97f5000b1d26 req-20204ce3-31df-45f1-a2c3-2e9e673c98d0 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:18.366691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-1e210ae8-bba0-4c59-8b3d-97f5000b1d26 req-20204ce3-31df-45f1-a2c3-2e9e673c98d0 service nova] Creating event network-vif-unplugged:c51643c6-7fc4-41fe-bb8c-e237ddadcdaf for instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 on hv-cinder-82413 Jan 11 14:18:18.379945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-1e210ae8-bba0-4c59-8b3d-97f5000b1d26 req-20204ce3-31df-45f1-a2c3-2e9e673c98d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046961 Jan 11 14:18:18.382353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 441/903] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:18.842737 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7744b3ae-ec6f-4101-bddd-60e222d62c0b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:18.843302 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7744b3ae-ec6f-4101-bddd-60e222d62c0b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:18.850783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7744b3ae-ec6f-4101-bddd-60e222d62c0b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:18.851226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7744b3ae-ec6f-4101-bddd-60e222d62c0b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:18.852204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7744b3ae-ec6f-4101-bddd-60e222d62c0b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:18.852854 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7744b3ae-ec6f-4101-bddd-60e222d62c0b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:18.884023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7744b3ae-ec6f-4101-bddd-60e222d62c0b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:18:18.992202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7744b3ae-ec6f-4101-bddd-60e222d62c0b tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 204 len: 0 microversion: 2.1 time: 0.153054 Jan 11 14:18:18.992905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 463/904] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:18:18 2022] DELETE /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:18:19.002529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-33d99fc7-1198-40b6-9ace-5308facc546f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:19.003247 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-33d99fc7-1198-40b6-9ace-5308facc546f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:19.013372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33d99fc7-1198-40b6-9ace-5308facc546f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:19.014093 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33d99fc7-1198-40b6-9ace-5308facc546f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:19.015202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33d99fc7-1198-40b6-9ace-5308facc546f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:19.016597 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33d99fc7-1198-40b6-9ace-5308facc546f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:19.246947 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-33d99fc7-1198-40b6-9ace-5308facc546f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:19.255834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-33d99fc7-1198-40b6-9ace-5308facc546f tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1513 microversion: 2.1 time: 0.258544 Jan 11 14:18:19.256416 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 442/905] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:18 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:18:19.267635 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:19.268605 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:19.275050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:19.275740 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:19.276753 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:19.277387 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:19.423946 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:19.434503 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:19.436837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:19.438228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0b92938b-0a44-4868-a86a-ddbf3a9ae0e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1661 microversion: 2.20 time: 0.174788 Jan 11 14:18:19.439308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 464/906] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:19 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1661 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:19.459611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ec1154bf-cb5f-4bdb-84fd-2bdbdbbe9e6c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7aeb02b-56b7-48c4-a0ab-0c8566e5d39d"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:19.461055 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ec1154bf-cb5f-4bdb-84fd-2bdbdbbe9e6c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:19.467790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ec1154bf-cb5f-4bdb-84fd-2bdbdbbe9e6c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:19.468244 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ec1154bf-cb5f-4bdb-84fd-2bdbdbbe9e6c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:19.469032 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ec1154bf-cb5f-4bdb-84fd-2bdbdbbe9e6c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:19.469469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ec1154bf-cb5f-4bdb-84fd-2bdbdbbe9e6c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:19.772716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ec1154bf-cb5f-4bdb-84fd-2bdbdbbe9e6c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317986 Jan 11 14:18:19.773326 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 443/907] 10.222.0.49 () {62 vars in 1363 bytes} [Tue Jan 11 14:18:19 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:18:19.928812 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c195cf4c-b089-41ff-952c-94c67dfebb5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:19.930169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c195cf4c-b089-41ff-952c-94c67dfebb5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:19.952705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c195cf4c-b089-41ff-952c-94c67dfebb5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:19.953409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c195cf4c-b089-41ff-952c-94c67dfebb5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:19.954429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c195cf4c-b089-41ff-952c-94c67dfebb5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:19.955079 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c195cf4c-b089-41ff-952c-94c67dfebb5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:20.273902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8e0871ec-aa52-4d53-9bf3-dc3880ff79ee tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:20.275221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8e0871ec-aa52-4d53-9bf3-dc3880ff79ee tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:20.283255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e0871ec-aa52-4d53-9bf3-dc3880ff79ee tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:20.284085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e0871ec-aa52-4d53-9bf3-dc3880ff79ee tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:20.285108 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e0871ec-aa52-4d53-9bf3-dc3880ff79ee tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:20.285786 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e0871ec-aa52-4d53-9bf3-dc3880ff79ee tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:20.396171 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c195cf4c-b089-41ff-952c-94c67dfebb5c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action" status: 202 len: 0 microversion: 2.20 time: 0.472012 Jan 11 14:18:20.397351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 465/908] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:18:19 2022] POST /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 11 14:18:20.411766 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:20.412601 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:20.426679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:20.427245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:20.428008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:20.428887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:20.584013 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8e0871ec-aa52-4d53-9bf3-dc3880ff79ee tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:20.597346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8e0871ec-aa52-4d53-9bf3-dc3880ff79ee tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1513 microversion: 2.1 time: 0.327195 Jan 11 14:18:20.597950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 444/909] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:20 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1513 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:18:20.772974 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-db2a4b44-606f-4838-89c8-8e4ec6d2775e req-80d6bedd-e376-429d-ad78-b2b3170d57f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682faefe-6922-4f9f-b5b8-48b8c9a49665", "tag": "c7e7af63-dba4-40f2-b97e-3dc8a5d14124"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:20.775465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:20.775465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:18:20.797647 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-db2a4b44-606f-4838-89c8-8e4ec6d2775e req-80d6bedd-e376-429d-ad78-b2b3170d57f4 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:20.797647 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-db2a4b44-606f-4838-89c8-8e4ec6d2775e req-80d6bedd-e376-429d-ad78-b2b3170d57f4 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:20.812489 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:20.820860 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:20.822579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:20.823814 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f954a9d3-3e75-4d50-a582-36298b92746d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1747 microversion: 2.20 time: 0.420999 Jan 11 14:18:20.829331 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 466/910] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:20 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1747 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:20.829881 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-db2a4b44-606f-4838-89c8-8e4ec6d2775e req-80d6bedd-e376-429d-ad78-b2b3170d57f4 service nova] Creating event network-changed:c7e7af63-dba4-40f2-b97e-3dc8a5d14124 for instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 on hv-cinder-82413 Jan 11 14:18:20.838486 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-db2a4b44-606f-4838-89c8-8e4ec6d2775e req-80d6bedd-e376-429d-ad78-b2b3170d57f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069968 Jan 11 14:18:20.840634 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 445/911] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:18:21.615934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f90cc4d9-1058-4df4-84af-ee5940a62b68 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:21.617152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f90cc4d9-1058-4df4-84af-ee5940a62b68 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:21.626935 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f90cc4d9-1058-4df4-84af-ee5940a62b68 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:21.630175 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f90cc4d9-1058-4df4-84af-ee5940a62b68 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:21.631012 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f90cc4d9-1058-4df4-84af-ee5940a62b68 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:21.631646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f90cc4d9-1058-4df4-84af-ee5940a62b68 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:21.844493 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:21.845198 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:21.856150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:21.856608 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:21.862010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:21.862697 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:22.333287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f90cc4d9-1058-4df4-84af-ee5940a62b68 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:22.355167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f90cc4d9-1058-4df4-84af-ee5940a62b68 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1513 microversion: 2.1 time: 0.741491 Jan 11 14:18:22.368858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 467/912] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:21 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1513 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:22.829652 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-c66e36ae-d79c-42d3-bb83-d3b93be02565 req-b489a9f7-dd4b-4402-8ca8-5d0f7a074297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe790a9d-f25c-4f0c-852d-3155d29520c0", "name": "network-vif-unplugged", "status": "completed", "tag": "e6f3dc3e-4f1c-4201-b63f-f6a4b7ffd872"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:22.831196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:22.831196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:18:22.850834 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-c66e36ae-d79c-42d3-bb83-d3b93be02565 req-b489a9f7-dd4b-4402-8ca8-5d0f7a074297 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:22.851370 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-c66e36ae-d79c-42d3-bb83-d3b93be02565 req-b489a9f7-dd4b-4402-8ca8-5d0f7a074297 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:22.891845 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-c66e36ae-d79c-42d3-bb83-d3b93be02565 req-b489a9f7-dd4b-4402-8ca8-5d0f7a074297 service nova] Creating event network-vif-unplugged:e6f3dc3e-4f1c-4201-b63f-f6a4b7ffd872 for instance fe790a9d-f25c-4f0c-852d-3155d29520c0 on hv-cinder-82413 Jan 11 14:18:22.910152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-c66e36ae-d79c-42d3-bb83-d3b93be02565 req-b489a9f7-dd4b-4402-8ca8-5d0f7a074297 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085079 Jan 11 14:18:22.915167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 468/913] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:22.955924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d262be90-50d2-4dbc-a3d1-c5a4a9a4af91 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1911624153"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:22.956755 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d262be90-50d2-4dbc-a3d1-c5a4a9a4af91 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:22.965278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d262be90-50d2-4dbc-a3d1-c5a4a9a4af91 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:22.966089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d262be90-50d2-4dbc-a3d1-c5a4a9a4af91 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:22.967055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d262be90-50d2-4dbc-a3d1-c5a4a9a4af91 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:22.967688 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d262be90-50d2-4dbc-a3d1-c5a4a9a4af91 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:23.109836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:23.121736 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:23.123527 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:23.124733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-49d797a9-1d8e-4bbc-9d72-6bf931d37d1e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1747 microversion: 2.20 time: 1.285291 Jan 11 14:18:23.125341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 446/914] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:21 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1747 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:23.373602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7c4b68e3-c508-479c-825a-46fbb63983f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:23.374180 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7c4b68e3-c508-479c-825a-46fbb63983f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:23.380315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c4b68e3-c508-479c-825a-46fbb63983f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:23.380769 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c4b68e3-c508-479c-825a-46fbb63983f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:23.381561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c4b68e3-c508-479c-825a-46fbb63983f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:23.382003 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c4b68e3-c508-479c-825a-46fbb63983f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:23.497939 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.network.security_group_api [None req-d262be90-50d2-4dbc-a3d1-c5a4a9a4af91 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Adding security group 2c5e9284-5045-4583-8aae-d83f9dfe6a7b to port c7e7af63-dba4-40f2-b97e-3dc8a5d14124 Jan 11 14:18:23.843358 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7c4b68e3-c508-479c-825a-46fbb63983f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f705ed82e441229edd5a48b3797b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02bf5f593a54c658a76fff0246febf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:23.852384 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7c4b68e3-c508-479c-825a-46fbb63983f5 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 200 len: 1513 microversion: 2.1 time: 0.482912 Jan 11 14:18:23.854013 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 447/915] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:23 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 1513 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:18:23.981419 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-df8b5009-96ca-4505-a653-f58f48c1aaa1 req-bcd43c4d-cf98-4719-9440-4862abc49bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe790a9d-f25c-4f0c-852d-3155d29520c0", "name": "network-vif-deleted", "tag": "e6f3dc3e-4f1c-4201-b63f-f6a4b7ffd872"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:23.983753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:23.983753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:18:23.998381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-df8b5009-96ca-4505-a653-f58f48c1aaa1 req-bcd43c4d-cf98-4719-9440-4862abc49bbd service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:23.999690 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-df8b5009-96ca-4505-a653-f58f48c1aaa1 req-bcd43c4d-cf98-4719-9440-4862abc49bbd service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:24.012786 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-df8b5009-96ca-4505-a653-f58f48c1aaa1 req-bcd43c4d-cf98-4719-9440-4862abc49bbd service nova] Creating event network-vif-deleted:e6f3dc3e-4f1c-4201-b63f-f6a4b7ffd872 for instance fe790a9d-f25c-4f0c-852d-3155d29520c0 on hv-cinder-82413 Jan 11 14:18:24.021912 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-df8b5009-96ca-4505-a653-f58f48c1aaa1 req-bcd43c4d-cf98-4719-9440-4862abc49bbd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156824 Jan 11 14:18:24.023074 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 448/916] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:24.142789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:24.144246 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:24.152176 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:24.152555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:24.153347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:24.153784 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:24.441929 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d262be90-50d2-4dbc-a3d1-c5a4a9a4af91 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "POST /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/action" status: 202 len: 0 microversion: 2.1 time: 1.490191 Jan 11 14:18:24.442637 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 469/917] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:18:22 2022] POST /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/action => generated 0 bytes in 1492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:18:24.459806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-93399a3a-ea8a-4ad8-8c77-05b0b4993401 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:24.463120 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-93399a3a-ea8a-4ad8-8c77-05b0b4993401 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:24.467361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:24.480497 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93399a3a-ea8a-4ad8-8c77-05b0b4993401 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:24.481323 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93399a3a-ea8a-4ad8-8c77-05b0b4993401 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:24.482523 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93399a3a-ea8a-4ad8-8c77-05b0b4993401 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:24.483515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93399a3a-ea8a-4ad8-8c77-05b0b4993401 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:24.506328 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:24.511320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:24.518686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-13ac3ec5-d1ff-427e-84bf-2761e94eca47 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.379977 Jan 11 14:18:24.519305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 449/918] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:24 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:18:24.797145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-93399a3a-ea8a-4ad8-8c77-05b0b4993401 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:24.814213 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-93399a3a-ea8a-4ad8-8c77-05b0b4993401 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1759 microversion: 2.1 time: 0.365854 Jan 11 14:18:24.815750 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 470/919] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:24 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1759 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:24.882586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:24.882586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] [instance: fe790a9d-f25c-4f0c-852d-3155d29520c0] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:24.889799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:24.890253 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:24.891062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:24.892012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:24.938166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] HTTP exception thrown: Instance fe790a9d-f25c-4f0c-852d-3155d29520c0 could not be found. Jan 11 14:18:24.938779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] Returning 404 to user: Instance fe790a9d-f25c-4f0c-852d-3155d29520c0 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:18:24.939665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7576bf77-17e4-49f5-adec-70df80e9f303 tempest-AttachVolumeNegativeTest-449829795 tempest-AttachVolumeNegativeTest-449829795-project] 10.222.0.49 "GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0" status: 404 len: 111 microversion: 2.1 time: 0.073373 Jan 11 14:18:24.944055 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 450/920] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:18:24 2022] GET /compute/v2.1/servers/fe790a9d-f25c-4f0c-852d-3155d29520c0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:18:25.537892 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:25.538633 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:25.549129 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:25.551283 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:25.552702 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:25.555035 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:26.033581 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:26.049961 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-4726bba1-d1dc-43cf-8b96-ed2a084303e8 req-a1c9db95-3b26-4fa4-b6f4-f8f9327b3995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682faefe-6922-4f9f-b5b8-48b8c9a49665", "tag": "c7e7af63-dba4-40f2-b97e-3dc8a5d14124"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:26.051567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:18:26.051567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:18:26.060363 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-4726bba1-d1dc-43cf-8b96-ed2a084303e8 req-a1c9db95-3b26-4fa4-b6f4-f8f9327b3995 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:26.060832 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-4726bba1-d1dc-43cf-8b96-ed2a084303e8 req-a1c9db95-3b26-4fa4-b6f4-f8f9327b3995 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:26.064728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:26.068204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:26.077062 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-59af4129-7abe-4247-bfcc-2e22acedef2c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.537040 Jan 11 14:18:26.079177 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 471/921] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:25 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:26.107298 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-4726bba1-d1dc-43cf-8b96-ed2a084303e8 req-a1c9db95-3b26-4fa4-b6f4-f8f9327b3995 service nova] Creating event network-changed:c7e7af63-dba4-40f2-b97e-3dc8a5d14124 for instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 on hv-cinder-82413 Jan 11 14:18:26.127573 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-4726bba1-d1dc-43cf-8b96-ed2a084303e8 req-a1c9db95-3b26-4fa4-b6f4-f8f9327b3995 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087155 Jan 11 14:18:26.128714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 451/922] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:18:27.099465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:27.100148 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:27.113378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:27.113841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:27.114654 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:27.115094 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:27.394562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:27.407419 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:27.410298 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:27.412999 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0114d433-41e8-40f4-895b-c20ff713b955 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.321452 Jan 11 14:18:27.419662 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 472/923] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:27 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:28.434583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:28.435369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:28.444809 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:28.445251 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:28.446063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:28.446501 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:28.760933 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:28.773579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:28.775649 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:28.777993 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8db7219c-5459-4d15-944e-43ce19cc93c5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.347382 Jan 11 14:18:28.779079 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 452/924] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:28 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:29.421526 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e6a16710-6f36-4c9c-baeb-06a2065a404b tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Action: 'create', calling method: .version_select at 0x7fba9107aee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1964499551"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:29.798477 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:29.799469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:29.822673 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:29.826237 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:29.828042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:29.829192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:30.147410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e6a16710-6f36-4c9c-baeb-06a2065a404b tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.057040 Jan 11 14:18:30.148450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 473/925] 10.222.0.49 () {60 vars in 1154 bytes} [Tue Jan 11 14:18:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1060 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 11 14:18:30.160598 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d54092ad-69c5-40d2-8337-85f1694a388d tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba91a761f0>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:30.202999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:30.226312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:30.228721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:30.242609 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d54092ad-69c5-40d2-8337-85f1694a388d tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210" status: 200 len: 345 microversion: 2.1 time: 0.086519 Jan 11 14:18:30.243461 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 474/926] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:18:30 2022] GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210 => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:30.249012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-11750874-a1dc-4216-861c-537c15d941d9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.454637 Jan 11 14:18:30.249762 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 453/927] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:29 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:18:31.256036 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5dbaeca4-ebb9-45f8-9c60-dffe0ecfc3d7 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba91bc38b0>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:31.269845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:31.271322 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:31.289097 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:31.292092 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:31.295335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:31.298120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:31.364904 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5dbaeca4-ebb9-45f8-9c60-dffe0ecfc3d7 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210" status: 200 len: 346 microversion: 2.1 time: 0.112925 Jan 11 14:18:31.366020 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 475/928] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:18:31 2022] GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210 => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:31.377033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0c427856-2877-4a5a-a47b-bf3b954ac4e8 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Action: 'create', calling method: .version_select at 0x7fba9107a550>, body: {"snapshot": {"volume_id": "ad3972a4-2674-46a6-9c9c-fac381ded210", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-401729372"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:31.638953 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0c427856-2877-4a5a-a47b-bf3b954ac4e8 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.265459 Jan 11 14:18:31.639667 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 476/929] 10.222.0.49 () {60 vars in 1161 bytes} [Tue Jan 11 14:18:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:31.649108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-712a194f-89e9-44c6-b7ff-186a83f8c19a tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba911489d0>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:31.661443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:31.672781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:31.681841 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:31.686208 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-083b4c27-2b69-45ff-b425-f1810ac7c2f0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.421972 Jan 11 14:18:31.690955 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 454/930] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:31 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:18:31.725200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-712a194f-89e9-44c6-b7ff-186a83f8c19a tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.078117 Jan 11 14:18:31.725200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 477/931] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:31 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:18:31.734173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-911f1349-63a4-487d-8232-a00f6e8f6b0d tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95dc5e50>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:31.795206 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-911f1349-63a4-487d-8232-a00f6e8f6b0d tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.064613 Jan 11 14:18:31.802632 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 455/932] 10.222.0.49 () {58 vars in 1139 bytes} [Tue Jan 11 14:18:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:31.808705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3a671b59-2dc2-453e-971c-80c444e422c9 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba91148b80>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:31.890365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3a671b59-2dc2-453e-971c-80c444e422c9 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.087233 Jan 11 14:18:31.895457 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 478/933] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:31 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:32.718154 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:32.720341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:32.736955 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:32.737871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:32.739114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:32.740378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:32.908725 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bdeadc33-f7d5-458d-a7c8-467385b53a55 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba9107a700>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:32.981860 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bdeadc33-f7d5-458d-a7c8-467385b53a55 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.079357 Jan 11 14:18:32.982784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 479/934] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:32 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:33.136764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:33.145558 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:33.147083 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:33.168769 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9eb503c3-a648-439c-9479-813a64875145 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.460920 Jan 11 14:18:33.169365 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 456/935] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:32 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:33.993948 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a1b6910e-6bba-4641-88d1-c0cce396c4ef tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba910fcb80>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:34.036886 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a1b6910e-6bba-4641-88d1-c0cce396c4ef tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.045774 Jan 11 14:18:34.037907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 480/936] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:33 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:34.189639 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:34.190320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:34.201663 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:34.202291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:34.204256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:34.204748 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:34.530050 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:34.546835 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:34.548756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:34.550216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-64a8c42e-8303-4692-880b-5cf39224ff76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.366014 Jan 11 14:18:34.551291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 457/937] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:34 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:35.052380 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5862c620-e8c6-47b9-bcf5-5d20afd44679 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba9107ac10>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:35.089753 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5862c620-e8c6-47b9-bcf5-5d20afd44679 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.041558 Jan 11 14:18:35.090490 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 481/938] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:35 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:35.570086 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-690228ee-61ff-436f-bb81-88287ef870a0 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Action: 'create', calling method: .version_select at 0x7fba95e363a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1740982666"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:18:35.577498 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:35.578113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:35.584911 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:35.585711 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:35.586145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:35.586726 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:35.591180 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-690228ee-61ff-436f-bb81-88287ef870a0 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for project 135a305e0bbe4cfcbfea666d19340195. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:18:35.595108 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-690228ee-61ff-436f-bb81-88287ef870a0 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for user 98f2499d9bdf4026b5f6b310d3e0b21c and project 135a305e0bbe4cfcbfea666d19340195. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:18:35.868595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-690228ee-61ff-436f-bb81-88287ef870a0 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for project 135a305e0bbe4cfcbfea666d19340195. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:18:35.872795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-690228ee-61ff-436f-bb81-88287ef870a0 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for user 98f2499d9bdf4026b5f6b310d3e0b21c and project 135a305e0bbe4cfcbfea666d19340195. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:18:35.890032 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-690228ee-61ff-436f-bb81-88287ef870a0 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.422953 Jan 11 14:18:35.890767 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 458/939] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Jan 11 14:18:35 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:18:35.901712 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:35.912889 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:35.914832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:35.916379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-47ff920e-9e1f-45fd-b631-6d8c7c691cb9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.351717 Jan 11 14:18:35.917622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 482/940] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:35 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:18:36.102859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9f8fdbb6-fede-48af-aa0b-4cd63c9b6a1e tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e28820>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:36.152430 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9f8fdbb6-fede-48af-aa0b-4cd63c9b6a1e tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.053123 Jan 11 14:18:36.153760 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 459/941] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:36 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:36.935686 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:36.936442 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:36.942961 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:36.943976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:36.945003 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:36.945639 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:37.123263 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:37.132319 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:37.133845 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:37.135067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6e4cd631-769f-4bcb-afed-66290c8bab76 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.203161 Jan 11 14:18:37.135657 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 483/942] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:36 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:37.164233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cb41e24f-0a8e-459e-ae56-61af6f27ebe7 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e34430>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:37.197115 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cb41e24f-0a8e-459e-ae56-61af6f27ebe7 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.036325 Jan 11 14:18:37.198237 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 460/943] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:37 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:38.153136 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:38.153759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:38.160176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:38.160633 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:38.161417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:38.161855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:38.209748 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-adf9eb39-fb4c-4604-b4ec-9cde8315742a tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e28ca0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:38.242081 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-adf9eb39-fb4c-4604-b4ec-9cde8315742a tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.036328 Jan 11 14:18:38.246061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 461/944] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:38 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:18:38.292901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:38.301698 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:38.303737 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:38.304899 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-91450bce-3644-4f9a-9c67-4ce29eeb3a10 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.156055 Jan 11 14:18:38.305446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 484/945] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:38 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:39.254112 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cb806a23-2a44-44dc-a0c3-a1b076e03ded tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e36ca0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:39.322914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:39.324783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:39.326856 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cb806a23-2a44-44dc-a0c3-a1b076e03ded tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.076902 Jan 11 14:18:39.327867 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 462/946] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:39 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:39.333225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:39.336989 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:39.338078 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:39.340130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:39.589816 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:39.599486 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:39.601512 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:39.602965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-eae12b8e-24f6-419c-8e5f-438e524f56b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.283830 Jan 11 14:18:39.604420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 485/947] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:39 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:40.338365 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fc8fe3ff-0402-4a4a-bb32-b753bfe55e24 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e14f70>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:40.373233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fc8fe3ff-0402-4a4a-bb32-b753bfe55e24 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.038923 Jan 11 14:18:40.374344 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 463/948] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:40 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:40.621922 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:40.622535 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:40.628813 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:40.629264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:40.630145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:40.630586 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:40.762785 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:40.770851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:40.772371 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:40.773510 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cb042252-91b2-4eea-ab2f-3610dd7f9aa1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.155424 Jan 11 14:18:40.774059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 486/949] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:40 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:41.385326 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c5b511e3-b422-45a3-bc2d-54c12fe9b550 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e36820>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:41.412893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c5b511e3-b422-45a3-bc2d-54c12fe9b550 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.031682 Jan 11 14:18:41.413449 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 464/950] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:41 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:41.792972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:41.793622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:41.799957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:41.800397 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:41.801182 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:41.801618 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:41.934053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:41.943283 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:41.944820 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:41.945983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f092e626-9b8b-48b6-bb37-0fbe527236fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.157321 Jan 11 14:18:41.946529 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 487/951] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:41 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:42.425844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8af61411-4ea4-4c02-afb3-3449c7f641e5 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba913a0700>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:42.457292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8af61411-4ea4-4c02-afb3-3449c7f641e5 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.035825 Jan 11 14:18:42.457865 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 465/952] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:42 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:42.964334 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:42.964940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:42.971122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:42.971619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:42.972409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:42.972903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:43.110345 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:43.118581 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:43.120695 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:43.121892 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-154ecdde-69da-4ffc-9211-c6a1b151cda2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.161381 Jan 11 14:18:43.122453 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 488/953] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:42 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:43.469641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-48003a13-7fe9-427f-aa98-cb62062a8633 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e34280>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:43.499031 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-48003a13-7fe9-427f-aa98-cb62062a8633 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 287 microversion: 2.1 time: 0.033428 Jan 11 14:18:43.499641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 466/954] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:43 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:43.509317 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7cd81e59-6892-4d3f-9fd9-102ef3c5f696 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba91a44310>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:43.563229 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7cd81e59-6892-4d3f-9fd9-102ef3c5f696 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 202 len: 0 microversion: 2.1 time: 0.057453 Jan 11 14:18:43.563845 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 489/955] 10.222.0.49 () {58 vars in 1253 bytes} [Tue Jan 11 14:18:43 2022] DELETE /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:18:43.571521 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f7c20e66-0cb4-4290-b891-02dae1c87a37 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba91286790>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:43.600358 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f7c20e66-0cb4-4290-b891-02dae1c87a37 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 200 len: 286 microversion: 2.1 time: 0.032265 Jan 11 14:18:43.601078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 467/956] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:43 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:44.140379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:44.140899 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:44.146851 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:44.147296 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:44.148093 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:44.148545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:44.287253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:44.296240 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:44.297806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:44.298956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5e999f60-4cbd-44d6-958f-4a12ab61d326 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.162895 Jan 11 14:18:44.299522 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 490/957] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:44 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:44.612957 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2c81185f-25f1-4423-834e-b1ca473031a7 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e36940>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:44.636114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-2c81185f-25f1-4423-834e-b1ca473031a7 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] HTTP exception thrown: Snapshot 37711f2a-e48a-4acd-b2fc-506f2a32d2b3 could not be found. Jan 11 14:18:44.636702 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2c81185f-25f1-4423-834e-b1ca473031a7 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Returning 404 to user: Snapshot 37711f2a-e48a-4acd-b2fc-506f2a32d2b3 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:18:44.637514 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2c81185f-25f1-4423-834e-b1ca473031a7 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3" status: 404 len: 111 microversion: 2.1 time: 0.028734 Jan 11 14:18:44.638037 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 468/958] 10.222.0.49 () {58 vars in 1250 bytes} [Tue Jan 11 14:18:44 2022] GET /compute/v2.1/os-snapshots/37711f2a-e48a-4acd-b2fc-506f2a32d2b3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:18:44.646757 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-33362a78-f463-4d84-8c77-8d29337aed85 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba91ae5700>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:44.711373 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-33362a78-f463-4d84-8c77-8d29337aed85 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210" status: 202 len: 0 microversion: 2.1 time: 0.068622 Jan 11 14:18:44.711984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 491/959] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Jan 11 14:18:44 2022] DELETE /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:18:44.720400 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0eecb1b7-d32f-40fe-b062-382641da5108 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba9128b1f0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:44.766590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0eecb1b7-d32f-40fe-b062-382641da5108 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210" status: 200 len: 345 microversion: 2.1 time: 0.050334 Jan 11 14:18:44.767355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 469/960] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:18:44 2022] GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:18:45.319977 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:45.320591 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:45.327450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:45.327929 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:45.328724 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:45.329160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:45.464369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:45.472556 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:45.474074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:45.475216 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0788722a-ad75-400d-bd87-3ab118082c7a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.159447 Jan 11 14:18:45.475807 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 492/961] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:45 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:45.780011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-86bfdf51-1d30-4e4b-9669-19da512ded27 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95e28dc0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:45.807644 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-86bfdf51-1d30-4e4b-9669-19da512ded27 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] HTTP exception thrown: Volume ad3972a4-2674-46a6-9c9c-fac381ded210 could not be found. Jan 11 14:18:45.808249 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-86bfdf51-1d30-4e4b-9669-19da512ded27 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Returning 404 to user: Volume ad3972a4-2674-46a6-9c9c-fac381ded210 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:18:45.809084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-86bfdf51-1d30-4e4b-9669-19da512ded27 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210" status: 404 len: 109 microversion: 2.1 time: 0.034115 Jan 11 14:18:45.809646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 470/962] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:18:45 2022] GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:18:45.824360 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8cf9b85d-a99d-4994-9024-6b2579c9311d tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba91ae5280>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:45.850778 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-8cf9b85d-a99d-4994-9024-6b2579c9311d tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] HTTP exception thrown: Volume ad3972a4-2674-46a6-9c9c-fac381ded210 could not be found. Jan 11 14:18:45.851387 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8cf9b85d-a99d-4994-9024-6b2579c9311d tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Returning 404 to user: Volume ad3972a4-2674-46a6-9c9c-fac381ded210 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:18:45.852259 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8cf9b85d-a99d-4994-9024-6b2579c9311d tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210" status: 404 len: 109 microversion: 2.1 time: 0.032064 Jan 11 14:18:45.852807 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 493/963] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Jan 11 14:18:45 2022] DELETE /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:18:45.861642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3ad4ebbd-672f-4db4-a9f7-a9f7dd60b024 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Calling method '.version_select at 0x7fba95ebf550>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:45.888385 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-3ad4ebbd-672f-4db4-a9f7-a9f7dd60b024 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] HTTP exception thrown: Volume ad3972a4-2674-46a6-9c9c-fac381ded210 could not be found. Jan 11 14:18:45.889002 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3ad4ebbd-672f-4db4-a9f7-a9f7dd60b024 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] Returning 404 to user: Volume ad3972a4-2674-46a6-9c9c-fac381ded210 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:18:45.889818 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3ad4ebbd-672f-4db4-a9f7-a9f7dd60b024 tempest-VolumesSnapshotsTestJSON-1787566996 tempest-VolumesSnapshotsTestJSON-1787566996-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210" status: 404 len: 109 microversion: 2.1 time: 0.031775 Jan 11 14:18:45.890358 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 471/964] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:18:45 2022] GET /compute/v2.1/os-volumes/ad3972a4-2674-46a6-9c9c-fac381ded210 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 14:18:46.495219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:46.496113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:46.503401 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:46.503907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:46.505043 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:46.505163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:46.647025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:46.656286 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:46.657813 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:46.658985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b19d5fd1-1f9f-4eb1-a3bd-4a120d63d9e5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.168625 Jan 11 14:18:46.659552 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 494/965] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:46 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:47.679831 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:47.680449 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:47.686905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:47.687359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:47.688342 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:47.688787 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:47.839885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:47.848940 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:47.850783 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:47.852186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c3ba1203-941f-44d4-9f6e-6b61ef52861e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.178838 Jan 11 14:18:47.852752 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 472/966] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:47 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:48.869925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:48.870538 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:48.876843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:48.877301 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:48.878085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:48.878532 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:49.006571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:49.015473 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:49.017048 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:49.018200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5067cc53-9835-4ef8-b625-0a3d036e7913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.152036 Jan 11 14:18:49.018743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 495/967] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:48 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:50.036654 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:50.037306 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:50.044609 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:50.045059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:50.045851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:50.046292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:50.183639 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:50.191858 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:50.193377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:50.194529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b1a84ee1-968a-441b-8df6-14d6fdeab5fb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.161606 Jan 11 14:18:50.195086 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 473/968] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:50 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:51.212533 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:51.213191 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:51.219705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:51.220152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:51.220932 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:51.221363 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:51.357348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:51.366078 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:51.367628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:51.368816 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-45f2877b-98cc-48f1-b1a8-b754d2f4b8a6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.159981 Jan 11 14:18:51.369962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 496/969] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:51 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:52.387995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:52.388682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:52.394781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:52.395233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:52.396049 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:52.396485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:52.529063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:52.537713 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:52.539712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:52.541478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d80e0f01-804e-488f-bd6d-31904f9ee449 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.157304 Jan 11 14:18:52.542226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 474/970] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:52 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:53.559065 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:53.559718 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:53.566105 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:53.566559 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:53.567351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:53.567871 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:53.710863 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:53.720009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:53.721467 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:53.722621 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-20b2d74b-6a81-4015-8fbd-0995a40d4925 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.167401 Jan 11 14:18:53.723171 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 497/971] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:53 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:54.741184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:54.742407 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:54.749721 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:54.750108 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:54.750842 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:54.751280 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:54.890498 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:54.898921 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:54.900471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:54.901636 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4486a512-3243-4ad8-9ac8-0b1637dd3c8e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.164375 Jan 11 14:18:54.902186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 475/972] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:54 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:55.919521 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:55.920247 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:55.926401 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:55.926852 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:55.927662 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:55.928105 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:56.063472 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:56.071593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:56.073686 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:56.075090 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5fa70d62-73b9-4268-9eb2-12fa49a67311 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.159256 Jan 11 14:18:56.075666 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 498/973] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:55 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:57.093649 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:57.094259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:57.100779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:57.101236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:57.102015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:57.102448 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:57.230975 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:57.239105 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:57.240661 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:57.241815 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b5aa5325-cd9e-4bf8-878f-07e5c5b8c87a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.151897 Jan 11 14:18:57.242375 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 476/974] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:57 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:58.259106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:58.259783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:58.266043 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:58.266489 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:58.267440 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:58.268066 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:58.423772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:58.436248 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:58.438769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:58.440623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3b767d00-7f09-4be1-85c8-9946d800136b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.184979 Jan 11 14:18:58.441187 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 499/975] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:58 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:18:59.457771 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:18:59.458378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:18:59.464627 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:59.465075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:59.465847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:18:59.466276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:18:59.593117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:59.601522 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:59.603041 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:18:59.604737 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-53adf38e-6468-4cb4-868d-6a4449557e61 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.150652 Jan 11 14:18:59.605289 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 477/976] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:18:59 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:19:00.580017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-b787bbf9-f146-4e4c-be49-d78077b5ad51 req-4bb0f3d8-d8bf-4266-aba9-3099b7b5bf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07361687-ec7a-4f6e-8e42-530c1a64ba04", "name": "network-vif-plugged", "status": "completed", "tag": "c51643c6-7fc4-41fe-bb8c-e237ddadcdaf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:19:00.581596 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:19:00.581596 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:19:00.588303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b787bbf9-f146-4e4c-be49-d78077b5ad51 req-4bb0f3d8-d8bf-4266-aba9-3099b7b5bf4b service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:00.588743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b787bbf9-f146-4e4c-be49-d78077b5ad51 req-4bb0f3d8-d8bf-4266-aba9-3099b7b5bf4b service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:00.598908 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-b787bbf9-f146-4e4c-be49-d78077b5ad51 req-4bb0f3d8-d8bf-4266-aba9-3099b7b5bf4b service nova] Creating event network-vif-plugged:c51643c6-7fc4-41fe-bb8c-e237ddadcdaf for instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 on hv-cinder-82413 Jan 11 14:19:00.604018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-b787bbf9-f146-4e4c-be49-d78077b5ad51 req-4bb0f3d8-d8bf-4266-aba9-3099b7b5bf4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163674 Jan 11 14:19:00.604639 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 500/977] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:19:00.623808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:00.624417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:00.630626 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:00.631076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:00.631909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:00.632404 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:00.770348 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:00.778555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:00.780117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:00.781275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f700b760-40ef-4bf4-ae55-ae8ee8bdb491 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.161745 Jan 11 14:19:00.781832 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 478/978] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:19:00 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:19:01.800432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:01.801152 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:01.808105 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:01.808566 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:01.809472 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:01.809967 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:01.941446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:01.950788 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:01.952354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:01.953518 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c42b178f-e012-4580-8d73-1ea22d87b34f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.157128 Jan 11 14:19:01.954073 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 501/979] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:19:01 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:19:02.970763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:02.971369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:02.977701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:02.978144 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:02.979573 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:02.980014 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:03.259398 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:03.268169 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:03.269210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:03.270398 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-491addc9-207d-46df-b267-c04913f52e75 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1805 microversion: 2.20 time: 0.303361 Jan 11 14:19:03.270937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 479/980] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:19:02 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1805 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:19:04.288107 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:04.288725 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:04.294951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:04.295403 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:04.296227 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:04.296670 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:04.430520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:04.438647 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:04.440214 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:04.441373 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c84fc164-40e3-42c6-be76-6be0874102ea tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1792 microversion: 2.20 time: 0.157093 Jan 11 14:19:04.441907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 502/981] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:19:04 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1792 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:19:17.374313 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-804176600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1740982666", "security_groups": [{"name": "tempest-secgroup-smoke-1576337113"}], "block_device_mapping_v2": [{"uuid": "597931e2-88b9-49ff-b7cf-c3b96e423fd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bafd8a92-c934-408c-97d9-8c6dc292a947"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:19:17.644347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] validate_networks() for [('bafd8a92-c934-408c-97d9-8c6dc292a947', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:19:18.304302 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:19:18.304731 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:19:18.305206 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:19:18.305616 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:19:18.306028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:19:18.314564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:18.315010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:18.315852 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:18.316290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:18.333217 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for project 135a305e0bbe4cfcbfea666d19340195. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:19:18.337085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for user 98f2499d9bdf4026b5f6b310d3e0b21c and project 135a305e0bbe4cfcbfea666d19340195. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:19:18.392945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:19:18.395090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='597931e2-88b9-49ff-b7cf-c3b96e423fd3',volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:19:18.540045 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4ea45db7-9d60-47ad-951a-4b31318e8047 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.169382 Jan 11 14:19:18.540780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 480/982] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:19:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:19:18.550462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b93b03a8-024d-4559-afd2-96f22a9dba68 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:18.551363 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b93b03a8-024d-4559-afd2-96f22a9dba68 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:18.612375 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b93b03a8-024d-4559-afd2-96f22a9dba68 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:18.619995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b93b03a8-024d-4559-afd2-96f22a9dba68 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1094 microversion: 2.1 time: 0.073000 Jan 11 14:19:18.620630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 503/983] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:18 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:19:19.638603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7c56dffb-f1bd-4682-9459-23db01fb59df tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:19.639203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7c56dffb-f1bd-4682-9459-23db01fb59df tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:19.645867 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c56dffb-f1bd-4682-9459-23db01fb59df tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:19.646319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c56dffb-f1bd-4682-9459-23db01fb59df tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:19.647132 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c56dffb-f1bd-4682-9459-23db01fb59df tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:19.647947 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7c56dffb-f1bd-4682-9459-23db01fb59df tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:19.719774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7c56dffb-f1bd-4682-9459-23db01fb59df tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:19.729049 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7c56dffb-f1bd-4682-9459-23db01fb59df tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1210 microversion: 2.1 time: 0.095109 Jan 11 14:19:19.729790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 481/984] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:19 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:20.747135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d82e81b2-794d-4fe3-8356-9f7637dc625b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:20.748128 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d82e81b2-794d-4fe3-8356-9f7637dc625b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:20.755103 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d82e81b2-794d-4fe3-8356-9f7637dc625b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:20.755822 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d82e81b2-794d-4fe3-8356-9f7637dc625b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:20.756870 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d82e81b2-794d-4fe3-8356-9f7637dc625b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:20.757376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d82e81b2-794d-4fe3-8356-9f7637dc625b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:20.922492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d82e81b2-794d-4fe3-8356-9f7637dc625b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:20.933640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d82e81b2-794d-4fe3-8356-9f7637dc625b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.190851 Jan 11 14:19:20.934859 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 504/985] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:20 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:21.316008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-b99b7a57-fb31-4e54-8fb1-77220f8f664a req-89c193ee-3864-47ad-a8ae-7df2d5ea8f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201aaa53-5bdd-4883-a883-71b16db0ec92", "tag": "5bad91d4-b4c4-4087-b072-80e2177b4913"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:19:21.317694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:19:21.317694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:19:21.325748 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-b99b7a57-fb31-4e54-8fb1-77220f8f664a req-89c193ee-3864-47ad-a8ae-7df2d5ea8f52 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:21.326255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-b99b7a57-fb31-4e54-8fb1-77220f8f664a req-89c193ee-3864-47ad-a8ae-7df2d5ea8f52 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:21.337364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-b99b7a57-fb31-4e54-8fb1-77220f8f664a req-89c193ee-3864-47ad-a8ae-7df2d5ea8f52 service nova] Creating event network-changed:5bad91d4-b4c4-4087-b072-80e2177b4913 for instance 201aaa53-5bdd-4883-a883-71b16db0ec92 on hv-cinder-82413 Jan 11 14:19:21.342738 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-b99b7a57-fb31-4e54-8fb1-77220f8f664a req-89c193ee-3864-47ad-a8ae-7df2d5ea8f52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186926 Jan 11 14:19:21.343318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 482/986] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:19:21.950317 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8facf45c-2f69-4512-85af-5f2443510650 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:21.951524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8facf45c-2f69-4512-85af-5f2443510650 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:21.957976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8facf45c-2f69-4512-85af-5f2443510650 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:21.958367 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8facf45c-2f69-4512-85af-5f2443510650 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:21.959204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8facf45c-2f69-4512-85af-5f2443510650 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:21.959682 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8facf45c-2f69-4512-85af-5f2443510650 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:22.091237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8facf45c-2f69-4512-85af-5f2443510650 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:22.098424 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8facf45c-2f69-4512-85af-5f2443510650 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.152125 Jan 11 14:19:22.098982 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 505/987] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:21 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:23.115589 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-aefec65a-1292-4205-b7da-bad6f251e564 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:23.116295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-aefec65a-1292-4205-b7da-bad6f251e564 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:23.122347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aefec65a-1292-4205-b7da-bad6f251e564 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:23.122795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aefec65a-1292-4205-b7da-bad6f251e564 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:23.123612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aefec65a-1292-4205-b7da-bad6f251e564 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:23.124053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aefec65a-1292-4205-b7da-bad6f251e564 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:23.253961 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-aefec65a-1292-4205-b7da-bad6f251e564 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:23.261050 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-aefec65a-1292-4205-b7da-bad6f251e564 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.149977 Jan 11 14:19:23.261603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 483/988] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:23 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:24.279978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7221c8f3-c0bf-453a-8fc9-98b37d76c7db tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:24.280583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7221c8f3-c0bf-453a-8fc9-98b37d76c7db tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:24.286749 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7221c8f3-c0bf-453a-8fc9-98b37d76c7db tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:24.287187 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7221c8f3-c0bf-453a-8fc9-98b37d76c7db tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:24.287996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7221c8f3-c0bf-453a-8fc9-98b37d76c7db tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:24.288431 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7221c8f3-c0bf-453a-8fc9-98b37d76c7db tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:24.422479 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7221c8f3-c0bf-453a-8fc9-98b37d76c7db tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:24.429758 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7221c8f3-c0bf-453a-8fc9-98b37d76c7db tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.154093 Jan 11 14:19:24.430308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 506/989] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:24 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:19:25.446184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5ba789de-fa24-46f6-81f5-9f991f62ae0c tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:25.446803 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5ba789de-fa24-46f6-81f5-9f991f62ae0c tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:25.453909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5ba789de-fa24-46f6-81f5-9f991f62ae0c tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:25.454359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5ba789de-fa24-46f6-81f5-9f991f62ae0c tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:25.455149 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5ba789de-fa24-46f6-81f5-9f991f62ae0c tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:25.455612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5ba789de-fa24-46f6-81f5-9f991f62ae0c tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:25.584695 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5ba789de-fa24-46f6-81f5-9f991f62ae0c tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:25.592702 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5ba789de-fa24-46f6-81f5-9f991f62ae0c tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.150255 Jan 11 14:19:25.593345 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 484/990] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:25 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:26.610496 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cb83bb98-1695-4c41-840c-0991d7694577 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:26.611409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cb83bb98-1695-4c41-840c-0991d7694577 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:26.618520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb83bb98-1695-4c41-840c-0991d7694577 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:26.618976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb83bb98-1695-4c41-840c-0991d7694577 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:26.619796 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb83bb98-1695-4c41-840c-0991d7694577 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:26.620239 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cb83bb98-1695-4c41-840c-0991d7694577 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:26.756064 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cb83bb98-1695-4c41-840c-0991d7694577 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:26.763306 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cb83bb98-1695-4c41-840c-0991d7694577 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.157757 Jan 11 14:19:26.764001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 507/991] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:26 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:27.780377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-efbb0689-2136-4650-96ce-4a84e69c9ab4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:27.780985 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-efbb0689-2136-4650-96ce-4a84e69c9ab4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:27.787191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-efbb0689-2136-4650-96ce-4a84e69c9ab4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:27.787669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-efbb0689-2136-4650-96ce-4a84e69c9ab4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:27.788450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-efbb0689-2136-4650-96ce-4a84e69c9ab4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:27.788884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-efbb0689-2136-4650-96ce-4a84e69c9ab4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:27.920502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-efbb0689-2136-4650-96ce-4a84e69c9ab4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:27.927892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-efbb0689-2136-4650-96ce-4a84e69c9ab4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.151698 Jan 11 14:19:27.928454 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 485/992] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:27 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:28.944104 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-58c79abf-9a74-4352-b2e3-d4686ef6c320 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:28.944736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-58c79abf-9a74-4352-b2e3-d4686ef6c320 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:28.951297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-58c79abf-9a74-4352-b2e3-d4686ef6c320 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:28.951772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-58c79abf-9a74-4352-b2e3-d4686ef6c320 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:28.952553 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-58c79abf-9a74-4352-b2e3-d4686ef6c320 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:28.952990 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-58c79abf-9a74-4352-b2e3-d4686ef6c320 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:29.084932 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-58c79abf-9a74-4352-b2e3-d4686ef6c320 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:29.092805 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-58c79abf-9a74-4352-b2e3-d4686ef6c320 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.152381 Jan 11 14:19:29.093366 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 508/993] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:28 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:30.109627 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9d30c9a5-0664-4be1-855b-d5e060b7cbec tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:30.110231 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9d30c9a5-0664-4be1-855b-d5e060b7cbec tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:30.116503 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9d30c9a5-0664-4be1-855b-d5e060b7cbec tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:30.116944 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9d30c9a5-0664-4be1-855b-d5e060b7cbec tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:30.117714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9d30c9a5-0664-4be1-855b-d5e060b7cbec tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:30.118146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9d30c9a5-0664-4be1-855b-d5e060b7cbec tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:30.259368 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9d30c9a5-0664-4be1-855b-d5e060b7cbec tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:30.266875 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9d30c9a5-0664-4be1-855b-d5e060b7cbec tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.161451 Jan 11 14:19:30.267427 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 486/994] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:30 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:31.283300 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3785f0eb-8f8d-4f24-9dd5-43a13b4d8880 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:31.283884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3785f0eb-8f8d-4f24-9dd5-43a13b4d8880 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:31.290923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3785f0eb-8f8d-4f24-9dd5-43a13b4d8880 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:31.291374 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3785f0eb-8f8d-4f24-9dd5-43a13b4d8880 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:31.292275 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3785f0eb-8f8d-4f24-9dd5-43a13b4d8880 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:31.292806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3785f0eb-8f8d-4f24-9dd5-43a13b4d8880 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:31.425131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3785f0eb-8f8d-4f24-9dd5-43a13b4d8880 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:31.433448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3785f0eb-8f8d-4f24-9dd5-43a13b4d8880 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.153931 Jan 11 14:19:31.434025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 509/995] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:31 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:32.450390 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-226fb478-9a6c-4f49-9c11-d0fd1f4f2716 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:32.451586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-226fb478-9a6c-4f49-9c11-d0fd1f4f2716 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:32.457848 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-226fb478-9a6c-4f49-9c11-d0fd1f4f2716 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:32.458300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-226fb478-9a6c-4f49-9c11-d0fd1f4f2716 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:32.459082 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-226fb478-9a6c-4f49-9c11-d0fd1f4f2716 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:32.459541 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-226fb478-9a6c-4f49-9c11-d0fd1f4f2716 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:32.595972 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-226fb478-9a6c-4f49-9c11-d0fd1f4f2716 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:32.603065 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-226fb478-9a6c-4f49-9c11-d0fd1f4f2716 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.156698 Jan 11 14:19:32.603637 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 487/996] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:32 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:33.627295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1921bd25-8364-4377-b685-992ee7f17b72 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:33.627958 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1921bd25-8364-4377-b685-992ee7f17b72 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:33.634374 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1921bd25-8364-4377-b685-992ee7f17b72 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:33.634829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1921bd25-8364-4377-b685-992ee7f17b72 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:33.635674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1921bd25-8364-4377-b685-992ee7f17b72 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:33.636099 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1921bd25-8364-4377-b685-992ee7f17b72 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:33.768723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1921bd25-8364-4377-b685-992ee7f17b72 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:33.776838 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1921bd25-8364-4377-b685-992ee7f17b72 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.160257 Jan 11 14:19:33.777419 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 510/997] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:33 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:34.793876 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-035ba925-d3af-4eda-a871-c7e015bf6e36 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:34.794479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-035ba925-d3af-4eda-a871-c7e015bf6e36 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:34.806199 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-035ba925-d3af-4eda-a871-c7e015bf6e36 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:34.806654 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-035ba925-d3af-4eda-a871-c7e015bf6e36 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:34.807461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-035ba925-d3af-4eda-a871-c7e015bf6e36 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:34.807930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-035ba925-d3af-4eda-a871-c7e015bf6e36 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:34.954126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-035ba925-d3af-4eda-a871-c7e015bf6e36 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:34.961382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-035ba925-d3af-4eda-a871-c7e015bf6e36 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.171337 Jan 11 14:19:34.961976 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 488/998] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:34 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:35.120768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-85fcc119-ea85-44db-b3bb-ac6ea343807d req-6ed5d119-7783-4cff-b61c-853fe2135987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201aaa53-5bdd-4883-a883-71b16db0ec92", "name": "network-vif-plugged", "status": "completed", "tag": "5bad91d4-b4c4-4087-b072-80e2177b4913"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:19:35.123121 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:19:35.123121 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:19:35.130570 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-85fcc119-ea85-44db-b3bb-ac6ea343807d req-6ed5d119-7783-4cff-b61c-853fe2135987 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:35.131171 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-85fcc119-ea85-44db-b3bb-ac6ea343807d req-6ed5d119-7783-4cff-b61c-853fe2135987 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:35.142786 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-85fcc119-ea85-44db-b3bb-ac6ea343807d req-6ed5d119-7783-4cff-b61c-853fe2135987 service nova] Creating event network-vif-plugged:5bad91d4-b4c4-4087-b072-80e2177b4913 for instance 201aaa53-5bdd-4883-a883-71b16db0ec92 on hv-cinder-82413 Jan 11 14:19:35.147804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-85fcc119-ea85-44db-b3bb-ac6ea343807d req-6ed5d119-7783-4cff-b61c-853fe2135987 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 Jan 11 14:19:35.148376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 511/999] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:19:35.978611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b2c3588d-c197-4d14-b9bc-b975f3e40eaa tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:35.979135 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b2c3588d-c197-4d14-b9bc-b975f3e40eaa tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:35.985020 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2c3588d-c197-4d14-b9bc-b975f3e40eaa tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:35.985465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2c3588d-c197-4d14-b9bc-b975f3e40eaa tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:35.986339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2c3588d-c197-4d14-b9bc-b975f3e40eaa tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:35.986781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2c3588d-c197-4d14-b9bc-b975f3e40eaa tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:36.125778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b2c3588d-c197-4d14-b9bc-b975f3e40eaa tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:36.134459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b2c3588d-c197-4d14-b9bc-b975f3e40eaa tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1266 microversion: 2.1 time: 0.159746 Jan 11 14:19:36.135019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 489/1000] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:35 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:37.153737 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-989d80b0-0f06-4939-b9a9-b0c05cc493d5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:37.155410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-989d80b0-0f06-4939-b9a9-b0c05cc493d5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:37.161579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-989d80b0-0f06-4939-b9a9-b0c05cc493d5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:37.162032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-989d80b0-0f06-4939-b9a9-b0c05cc493d5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:37.162823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-989d80b0-0f06-4939-b9a9-b0c05cc493d5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:37.163276 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-989d80b0-0f06-4939-b9a9-b0c05cc493d5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:37.300628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-989d80b0-0f06-4939-b9a9-b0c05cc493d5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:37.307950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-989d80b0-0f06-4939-b9a9-b0c05cc493d5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1454 microversion: 2.1 time: 0.160058 Jan 11 14:19:37.308508 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 512/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:37 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:37.323300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-644f98d3-746f-4bb8-9f2f-260936757430 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:19:37.323950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-644f98d3-746f-4bb8-9f2f-260936757430 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:19:37.330348 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-644f98d3-746f-4bb8-9f2f-260936757430 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:37.330793 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-644f98d3-746f-4bb8-9f2f-260936757430 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:37.331659 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-644f98d3-746f-4bb8-9f2f-260936757430 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:37.332092 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-644f98d3-746f-4bb8-9f2f-260936757430 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:37.467578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-644f98d3-746f-4bb8-9f2f-260936757430 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:19:37.475132 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-644f98d3-746f-4bb8-9f2f-260936757430 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1454 microversion: 2.1 time: 0.155446 Jan 11 14:19:37.475728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 490/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:19:37 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:19:39.223584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-56706984-14c6-4de1-9647-9dcec4ae79df req-da8fd61c-eafc-435b-a640-ce8e77fa06e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201aaa53-5bdd-4883-a883-71b16db0ec92", "tag": "5bad91d4-b4c4-4087-b072-80e2177b4913"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:19:39.225244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:19:39.225244 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:19:39.233226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-56706984-14c6-4de1-9647-9dcec4ae79df req-da8fd61c-eafc-435b-a640-ce8e77fa06e3 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:19:39.233672 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-56706984-14c6-4de1-9647-9dcec4ae79df req-da8fd61c-eafc-435b-a640-ce8e77fa06e3 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:19:39.251555 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-56706984-14c6-4de1-9647-9dcec4ae79df req-da8fd61c-eafc-435b-a640-ce8e77fa06e3 service nova] Creating event network-changed:5bad91d4-b4c4-4087-b072-80e2177b4913 for instance 201aaa53-5bdd-4883-a883-71b16db0ec92 on hv-cinder-82413 Jan 11 14:19:39.256648 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-56706984-14c6-4de1-9647-9dcec4ae79df req-da8fd61c-eafc-435b-a640-ce8e77fa06e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036908 Jan 11 14:19:39.257667 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 513/1003] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:20:00.775476 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a3020f0b-885c-4fd7-9983-9c008045a232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:00.776003 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a3020f0b-885c-4fd7-9983-9c008045a232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:00.782910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a3020f0b-885c-4fd7-9983-9c008045a232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:00.783362 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a3020f0b-885c-4fd7-9983-9c008045a232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:00.784190 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a3020f0b-885c-4fd7-9983-9c008045a232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:00.784628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a3020f0b-885c-4fd7-9983-9c008045a232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:00.860271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-a3020f0b-885c-4fd7-9983-9c008045a232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lazy-loading 'services' on Instance uuid da33a406-0839-4a04-9800-1444f9ae0b82 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:20:00.927106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a3020f0b-885c-4fd7-9983-9c008045a232 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/os-volume_attachments/2cab185c-2097-4f31-9088-a93eb0fab169" status: 202 len: 0 microversion: 2.1 time: 0.155294 Jan 11 14:20:00.927740 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 491/1004] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:20:00 2022] DELETE /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/os-volume_attachments/2cab185c-2097-4f31-9088-a93eb0fab169 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:02.034470 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3f03c9ea-22fd-4e75-91c2-ba477127f58d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:02.041032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3f03c9ea-22fd-4e75-91c2-ba477127f58d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:02.041483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3f03c9ea-22fd-4e75-91c2-ba477127f58d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:02.102223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3f03c9ea-22fd-4e75-91c2-ba477127f58d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Going to try to stop instance {{(pid=116474) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 11 14:20:02.142765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3f03c9ea-22fd-4e75-91c2-ba477127f58d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 202 len: 0 microversion: 2.1 time: 0.112281 Jan 11 14:20:02.143567 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 514/1005] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:20:02 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:02.152462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3c4cfeaa-48d9-44bb-b484-ff239f064dc2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:02.153166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3c4cfeaa-48d9-44bb-b484-ff239f064dc2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:02.159402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3c4cfeaa-48d9-44bb-b484-ff239f064dc2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:02.160068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3c4cfeaa-48d9-44bb-b484-ff239f064dc2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:02.160846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3c4cfeaa-48d9-44bb-b484-ff239f064dc2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:02.161470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3c4cfeaa-48d9-44bb-b484-ff239f064dc2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:02.293738 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3c4cfeaa-48d9-44bb-b484-ff239f064dc2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:02.301828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3c4cfeaa-48d9-44bb-b484-ff239f064dc2 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.153834 Jan 11 14:20:02.302376 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 492/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:02 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:03.320202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1a35f959-4733-44ae-9015-77650c1b715b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:03.320817 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1a35f959-4733-44ae-9015-77650c1b715b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:03.327524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1a35f959-4733-44ae-9015-77650c1b715b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:03.327974 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1a35f959-4733-44ae-9015-77650c1b715b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:03.329384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1a35f959-4733-44ae-9015-77650c1b715b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:03.329817 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1a35f959-4733-44ae-9015-77650c1b715b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:03.459820 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1a35f959-4733-44ae-9015-77650c1b715b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:03.467031 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1a35f959-4733-44ae-9015-77650c1b715b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.150955 Jan 11 14:20:03.467633 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 515/1007] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:03 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:04.485098 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7992ce85-222a-410a-8f05-c2ae9ec920e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:04.485631 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7992ce85-222a-410a-8f05-c2ae9ec920e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:04.491760 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7992ce85-222a-410a-8f05-c2ae9ec920e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:04.492206 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7992ce85-222a-410a-8f05-c2ae9ec920e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:04.492978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7992ce85-222a-410a-8f05-c2ae9ec920e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:04.493410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7992ce85-222a-410a-8f05-c2ae9ec920e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:04.619128 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7992ce85-222a-410a-8f05-c2ae9ec920e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:04.626353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7992ce85-222a-410a-8f05-c2ae9ec920e1 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.145028 Jan 11 14:20:04.626900 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 493/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:04 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:05.643293 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-024c893d-3a1c-44a5-80d3-dbcbe4297f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:05.643914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-024c893d-3a1c-44a5-80d3-dbcbe4297f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:05.650129 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-024c893d-3a1c-44a5-80d3-dbcbe4297f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:05.650583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-024c893d-3a1c-44a5-80d3-dbcbe4297f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:05.651362 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-024c893d-3a1c-44a5-80d3-dbcbe4297f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:05.651837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-024c893d-3a1c-44a5-80d3-dbcbe4297f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:05.781459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-024c893d-3a1c-44a5-80d3-dbcbe4297f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:05.789289 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-024c893d-3a1c-44a5-80d3-dbcbe4297f57 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.149799 Jan 11 14:20:05.789847 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 516/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:05 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:06.805939 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-de8470cd-2537-46e5-9c29-46cd7f92454e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:06.806547 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-de8470cd-2537-46e5-9c29-46cd7f92454e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:06.812450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de8470cd-2537-46e5-9c29-46cd7f92454e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:06.812897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de8470cd-2537-46e5-9c29-46cd7f92454e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:06.814290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de8470cd-2537-46e5-9c29-46cd7f92454e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:06.814723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de8470cd-2537-46e5-9c29-46cd7f92454e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:06.949774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-de8470cd-2537-46e5-9c29-46cd7f92454e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:06.957066 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-de8470cd-2537-46e5-9c29-46cd7f92454e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.154745 Jan 11 14:20:06.957560 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 494/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:06 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:07.044695 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-eef77bc2-2491-44e5-82e4-4c474dfd761c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:07.045716 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-eef77bc2-2491-44e5-82e4-4c474dfd761c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:07.052403 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eef77bc2-2491-44e5-82e4-4c474dfd761c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:07.052853 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eef77bc2-2491-44e5-82e4-4c474dfd761c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:07.053657 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eef77bc2-2491-44e5-82e4-4c474dfd761c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:07.054088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-eef77bc2-2491-44e5-82e4-4c474dfd761c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:07.121447 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-eef77bc2-2491-44e5-82e4-4c474dfd761c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "POST /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/action" status: 202 len: 0 microversion: 2.1 time: 0.080303 Jan 11 14:20:07.122106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 517/1011] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:20:07 2022] POST /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:07.129995 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-46434ea0-ebb3-4b34-a8a6-c8131ecaaf5e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:07.130604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-46434ea0-ebb3-4b34-a8a6-c8131ecaaf5e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:07.136402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-46434ea0-ebb3-4b34-a8a6-c8131ecaaf5e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:07.136846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-46434ea0-ebb3-4b34-a8a6-c8131ecaaf5e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:07.137618 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-46434ea0-ebb3-4b34-a8a6-c8131ecaaf5e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:07.138046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-46434ea0-ebb3-4b34-a8a6-c8131ecaaf5e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:07.284043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-46434ea0-ebb3-4b34-a8a6-c8131ecaaf5e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:07.294276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-46434ea0-ebb3-4b34-a8a6-c8131ecaaf5e tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1751 microversion: 2.1 time: 0.167748 Jan 11 14:20:07.295160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 495/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:07 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:07.974297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-888ef7bd-bb97-4df8-aebe-8ba369aa8c10 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:07.975011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-888ef7bd-bb97-4df8-aebe-8ba369aa8c10 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:07.981104 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-888ef7bd-bb97-4df8-aebe-8ba369aa8c10 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:07.981554 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-888ef7bd-bb97-4df8-aebe-8ba369aa8c10 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:07.982330 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-888ef7bd-bb97-4df8-aebe-8ba369aa8c10 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:07.982767 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-888ef7bd-bb97-4df8-aebe-8ba369aa8c10 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:08.111991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-888ef7bd-bb97-4df8-aebe-8ba369aa8c10 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:08.119264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-888ef7bd-bb97-4df8-aebe-8ba369aa8c10 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.149018 Jan 11 14:20:08.119852 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 518/1013] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:07 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:08.312143 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5e16a207-53cd-40ad-803b-e14f22a787e9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:08.312654 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5e16a207-53cd-40ad-803b-e14f22a787e9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:08.318880 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e16a207-53cd-40ad-803b-e14f22a787e9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:08.319335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e16a207-53cd-40ad-803b-e14f22a787e9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:08.320150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e16a207-53cd-40ad-803b-e14f22a787e9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:08.320593 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e16a207-53cd-40ad-803b-e14f22a787e9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:08.459167 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5e16a207-53cd-40ad-803b-e14f22a787e9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:08.466904 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5e16a207-53cd-40ad-803b-e14f22a787e9 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.158516 Jan 11 14:20:08.467510 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 496/1014] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:08 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:09.136088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1c6ca285-97e2-4be5-ba47-762ffa80af93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:09.136699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1c6ca285-97e2-4be5-ba47-762ffa80af93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:09.142820 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c6ca285-97e2-4be5-ba47-762ffa80af93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:09.143284 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c6ca285-97e2-4be5-ba47-762ffa80af93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:09.144066 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c6ca285-97e2-4be5-ba47-762ffa80af93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:09.144503 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1c6ca285-97e2-4be5-ba47-762ffa80af93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:09.276134 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1c6ca285-97e2-4be5-ba47-762ffa80af93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:09.283316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1c6ca285-97e2-4be5-ba47-762ffa80af93 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.150923 Jan 11 14:20:09.283905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 519/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:09 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:09.484450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cad83a8e-6f40-472c-9112-89cf8a11a0c0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:09.485114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cad83a8e-6f40-472c-9112-89cf8a11a0c0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:09.491280 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cad83a8e-6f40-472c-9112-89cf8a11a0c0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:09.491761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cad83a8e-6f40-472c-9112-89cf8a11a0c0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:09.492540 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cad83a8e-6f40-472c-9112-89cf8a11a0c0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:09.492978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cad83a8e-6f40-472c-9112-89cf8a11a0c0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:09.631072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cad83a8e-6f40-472c-9112-89cf8a11a0c0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:09.638684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cad83a8e-6f40-472c-9112-89cf8a11a0c0 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.157855 Jan 11 14:20:09.639241 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 497/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:09 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:10.300717 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0ad092c6-94f9-47f3-8001-3bae810ba7cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:10.301357 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0ad092c6-94f9-47f3-8001-3bae810ba7cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:10.307578 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ad092c6-94f9-47f3-8001-3bae810ba7cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:10.308033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ad092c6-94f9-47f3-8001-3bae810ba7cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:10.308816 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ad092c6-94f9-47f3-8001-3bae810ba7cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:10.309255 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ad092c6-94f9-47f3-8001-3bae810ba7cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:10.434837 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0ad092c6-94f9-47f3-8001-3bae810ba7cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:10.442225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0ad092c6-94f9-47f3-8001-3bae810ba7cf tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.145772 Jan 11 14:20:10.442783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 520/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:10 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:10.655157 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c5b7421c-f21b-4911-959c-1d1d18bd62a2 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:10.655806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c5b7421c-f21b-4911-959c-1d1d18bd62a2 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:10.662578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c5b7421c-f21b-4911-959c-1d1d18bd62a2 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:10.663028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c5b7421c-f21b-4911-959c-1d1d18bd62a2 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:10.663831 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c5b7421c-f21b-4911-959c-1d1d18bd62a2 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:10.664272 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c5b7421c-f21b-4911-959c-1d1d18bd62a2 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:10.805058 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c5b7421c-f21b-4911-959c-1d1d18bd62a2 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:10.812701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c5b7421c-f21b-4911-959c-1d1d18bd62a2 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.161176 Jan 11 14:20:10.813755 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 498/1018] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:10 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:11.459983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-db27bd92-b4eb-4d23-9e4d-83d2df347f34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:11.460634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-db27bd92-b4eb-4d23-9e4d-83d2df347f34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:11.466823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db27bd92-b4eb-4d23-9e4d-83d2df347f34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:11.467263 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db27bd92-b4eb-4d23-9e4d-83d2df347f34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:11.468058 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db27bd92-b4eb-4d23-9e4d-83d2df347f34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:11.468488 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db27bd92-b4eb-4d23-9e4d-83d2df347f34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:11.593811 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-db27bd92-b4eb-4d23-9e4d-83d2df347f34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:11.601227 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-db27bd92-b4eb-4d23-9e4d-83d2df347f34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1677 microversion: 2.1 time: 0.144899 Jan 11 14:20:11.601792 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 521/1019] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:11 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:11.830737 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4e967a14-89c5-4c3f-8803-61f15776004f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:11.831285 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4e967a14-89c5-4c3f-8803-61f15776004f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:11.837471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4e967a14-89c5-4c3f-8803-61f15776004f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:11.837956 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4e967a14-89c5-4c3f-8803-61f15776004f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:11.838696 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4e967a14-89c5-4c3f-8803-61f15776004f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:11.839131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4e967a14-89c5-4c3f-8803-61f15776004f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:11.980141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4e967a14-89c5-4c3f-8803-61f15776004f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:11.992796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4e967a14-89c5-4c3f-8803-61f15776004f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.166053 Jan 11 14:20:11.993360 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 499/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:11 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:12.618111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-65f5b331-b6ee-4d28-97c9-ad39f3b37b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:12.618719 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-65f5b331-b6ee-4d28-97c9-ad39f3b37b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:12.625078 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-65f5b331-b6ee-4d28-97c9-ad39f3b37b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:12.625528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-65f5b331-b6ee-4d28-97c9-ad39f3b37b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:12.626306 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-65f5b331-b6ee-4d28-97c9-ad39f3b37b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:12.626741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-65f5b331-b6ee-4d28-97c9-ad39f3b37b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:12.752776 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-65f5b331-b6ee-4d28-97c9-ad39f3b37b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:12.760129 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-65f5b331-b6ee-4d28-97c9-ad39f3b37b49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1654 microversion: 2.1 time: 0.145721 Jan 11 14:20:12.760683 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 522/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:12 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:12.776509 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b115b816-9310-4f6f-868a-8d33d52f2cd9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:12.782846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b115b816-9310-4f6f-868a-8d33d52f2cd9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:12.783291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b115b816-9310-4f6f-868a-8d33d52f2cd9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:12.804698 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b115b816-9310-4f6f-868a-8d33d52f2cd9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Going to try to start instance {{(pid=116475) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 11 14:20:12.845681 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b115b816-9310-4f6f-868a-8d33d52f2cd9 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action" status: 202 len: 0 microversion: 2.1 time: 0.072575 Jan 11 14:20:12.846371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 500/1022] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:20:12 2022] POST /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:12.854441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ca39ce2e-921d-432a-92bf-71b312a6daa7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:12.855103 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ca39ce2e-921d-432a-92bf-71b312a6daa7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:12.861108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ca39ce2e-921d-432a-92bf-71b312a6daa7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:12.861643 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ca39ce2e-921d-432a-92bf-71b312a6daa7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:12.862533 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ca39ce2e-921d-432a-92bf-71b312a6daa7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:12.863001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ca39ce2e-921d-432a-92bf-71b312a6daa7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:12.995452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ca39ce2e-921d-432a-92bf-71b312a6daa7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:13.003386 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ca39ce2e-921d-432a-92bf-71b312a6daa7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1663 microversion: 2.1 time: 0.152774 Jan 11 14:20:13.004082 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 523/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:12 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:13.011730 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fd16c357-472b-4b8d-b28d-4429d22c4e55 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:13.012643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fd16c357-472b-4b8d-b28d-4429d22c4e55 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:13.019123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fd16c357-472b-4b8d-b28d-4429d22c4e55 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:13.019596 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fd16c357-472b-4b8d-b28d-4429d22c4e55 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:13.020371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fd16c357-472b-4b8d-b28d-4429d22c4e55 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:13.020801 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fd16c357-472b-4b8d-b28d-4429d22c4e55 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:13.161550 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fd16c357-472b-4b8d-b28d-4429d22c4e55 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:13.169405 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fd16c357-472b-4b8d-b28d-4429d22c4e55 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.161698 Jan 11 14:20:13.169975 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 501/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:13 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:14.020462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5ff14101-879b-4c88-8591-c89ce47c31e3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:14.021073 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5ff14101-879b-4c88-8591-c89ce47c31e3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:14.027275 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5ff14101-879b-4c88-8591-c89ce47c31e3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:14.027748 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5ff14101-879b-4c88-8591-c89ce47c31e3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:14.028520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5ff14101-879b-4c88-8591-c89ce47c31e3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:14.028950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5ff14101-879b-4c88-8591-c89ce47c31e3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:14.155743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5ff14101-879b-4c88-8591-c89ce47c31e3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:14.164503 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5ff14101-879b-4c88-8591-c89ce47c31e3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1663 microversion: 2.1 time: 0.147679 Jan 11 14:20:14.165077 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 524/1025] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:14 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:14.185800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7b81d1e4-f148-45bc-a705-097e67008472 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:14.186413 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7b81d1e4-f148-45bc-a705-097e67008472 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:14.192691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7b81d1e4-f148-45bc-a705-097e67008472 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:14.193139 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7b81d1e4-f148-45bc-a705-097e67008472 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:14.193911 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7b81d1e4-f148-45bc-a705-097e67008472 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:14.194342 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7b81d1e4-f148-45bc-a705-097e67008472 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:14.342479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7b81d1e4-f148-45bc-a705-097e67008472 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:14.350834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7b81d1e4-f148-45bc-a705-097e67008472 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.168686 Jan 11 14:20:14.351394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 502/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:14 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:15.181605 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7e893646-b51f-4027-a18a-e5f18648363a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:15.182208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7e893646-b51f-4027-a18a-e5f18648363a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:15.188432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7e893646-b51f-4027-a18a-e5f18648363a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.188877 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7e893646-b51f-4027-a18a-e5f18648363a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.189647 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7e893646-b51f-4027-a18a-e5f18648363a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.190079 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7e893646-b51f-4027-a18a-e5f18648363a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.316703 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7e893646-b51f-4027-a18a-e5f18648363a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:15.323872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7e893646-b51f-4027-a18a-e5f18648363a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1667 microversion: 2.1 time: 0.145898 Jan 11 14:20:15.324673 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 525/1027] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:15 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1667 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:15.338232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-64ab492a-4bf6-4179-ae3a-9da94b51cd0e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:15.338760 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-64ab492a-4bf6-4179-ae3a-9da94b51cd0e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:15.345085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64ab492a-4bf6-4179-ae3a-9da94b51cd0e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.345529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64ab492a-4bf6-4179-ae3a-9da94b51cd0e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.346305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64ab492a-4bf6-4179-ae3a-9da94b51cd0e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.346735 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64ab492a-4bf6-4179-ae3a-9da94b51cd0e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.367598 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ae62fa4b-f3d8-452f-8af8-b20acf792c31 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:15.368334 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ae62fa4b-f3d8-452f-8af8-b20acf792c31 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:15.374017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae62fa4b-f3d8-452f-8af8-b20acf792c31 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.374466 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae62fa4b-f3d8-452f-8af8-b20acf792c31 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.374586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-64ab492a-4bf6-4179-ae3a-9da94b51cd0e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments/c7aeb02b-56b7-48c4-a0ab-0c8566e5d39d" status: 200 len: 194 microversion: 2.20 time: 0.040013 Jan 11 14:20:15.375124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 503/1028] 10.222.0.49 () {60 vars in 1453 bytes} [Tue Jan 11 14:20:15 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments/c7aeb02b-56b7-48c4-a0ab-0c8566e5d39d => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:20:15.375801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae62fa4b-f3d8-452f-8af8-b20acf792c31 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.376232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae62fa4b-f3d8-452f-8af8-b20acf792c31 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.435555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-511d6d51-63a7-4d61-b0e6-baf99455e2c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:15.436053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-511d6d51-63a7-4d61-b0e6-baf99455e2c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:15.442342 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-511d6d51-63a7-4d61-b0e6-baf99455e2c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.442794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-511d6d51-63a7-4d61-b0e6-baf99455e2c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.443607 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-511d6d51-63a7-4d61-b0e6-baf99455e2c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.444047 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-511d6d51-63a7-4d61-b0e6-baf99455e2c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.519541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ae62fa4b-f3d8-452f-8af8-b20acf792c31 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:15.521056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-511d6d51-63a7-4d61-b0e6-baf99455e2c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lazy-loading 'services' on Instance uuid 07361687-ec7a-4f6e-8e42-530c1a64ba04 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:20:15.527277 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ae62fa4b-f3d8-452f-8af8-b20acf792c31 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.163265 Jan 11 14:20:15.527866 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 526/1029] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:15 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:20:15.587906 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-511d6d51-63a7-4d61-b0e6-baf99455e2c4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments/c7aeb02b-56b7-48c4-a0ab-0c8566e5d39d" status: 202 len: 0 microversion: 2.20 time: 0.155629 Jan 11 14:20:15.588491 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 504/1030] 10.222.0.49 () {60 vars in 1456 bytes} [Tue Jan 11 14:20:15 2022] DELETE /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments/c7aeb02b-56b7-48c4-a0ab-0c8566e5d39d => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 11 14:20:15.600408 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7a7c45f5-aaba-4272-a330-7fb1753b6790 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:15.602015 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7a7c45f5-aaba-4272-a330-7fb1753b6790 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:15.611828 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a7c45f5-aaba-4272-a330-7fb1753b6790 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.612656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a7c45f5-aaba-4272-a330-7fb1753b6790 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.613700 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a7c45f5-aaba-4272-a330-7fb1753b6790 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:15.614258 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7a7c45f5-aaba-4272-a330-7fb1753b6790 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:15.654124 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7a7c45f5-aaba-4272-a330-7fb1753b6790 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060893 Jan 11 14:20:15.655011 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 527/1031] 10.222.0.49 () {60 vars in 1342 bytes} [Tue Jan 11 14:20:15 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:20:16.543673 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1cb71548-bb8c-4281-8744-517146690392 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:16.544281 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1cb71548-bb8c-4281-8744-517146690392 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:16.550757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1cb71548-bb8c-4281-8744-517146690392 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:16.551203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1cb71548-bb8c-4281-8744-517146690392 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:16.551996 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1cb71548-bb8c-4281-8744-517146690392 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:16.552428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1cb71548-bb8c-4281-8744-517146690392 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:16.666125 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a6f6ac4e-5bf1-4f1b-ae12-ec36bb299f7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:16.667042 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a6f6ac4e-5bf1-4f1b-ae12-ec36bb299f7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:16.673402 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a6f6ac4e-5bf1-4f1b-ae12-ec36bb299f7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:16.673857 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a6f6ac4e-5bf1-4f1b-ae12-ec36bb299f7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:16.674650 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a6f6ac4e-5bf1-4f1b-ae12-ec36bb299f7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:16.675088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a6f6ac4e-5bf1-4f1b-ae12-ec36bb299f7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:16.700724 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1cb71548-bb8c-4281-8744-517146690392 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:16.708212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1cb71548-bb8c-4281-8744-517146690392 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.168641 Jan 11 14:20:16.709077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 505/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:16 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:16.710489 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a6f6ac4e-5bf1-4f1b-ae12-ec36bb299f7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048148 Jan 11 14:20:16.711048 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 528/1033] 10.222.0.49 () {60 vars in 1342 bytes} [Tue Jan 11 14:20:16 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:20:16.764502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8c56177f-aad9-4aa9-b210-f1b26c0a6042 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:16.765003 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8c56177f-aad9-4aa9-b210-f1b26c0a6042 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:16.771371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c56177f-aad9-4aa9-b210-f1b26c0a6042 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:16.771935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c56177f-aad9-4aa9-b210-f1b26c0a6042 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:16.772753 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c56177f-aad9-4aa9-b210-f1b26c0a6042 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:16.773195 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8c56177f-aad9-4aa9-b210-f1b26c0a6042 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:16.797443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8c56177f-aad9-4aa9-b210-f1b26c0a6042 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Going to try to terminate instance {{(pid=116475) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:20:16.874927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8c56177f-aad9-4aa9-b210-f1b26c0a6042 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 204 len: 0 microversion: 2.20 time: 0.112610 Jan 11 14:20:16.876452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 506/1034] 10.222.0.49 () {60 vars in 1279 bytes} [Tue Jan 11 14:20:16 2022] DELETE /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 14:20:16.884354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:16.884961 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:16.890637 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:16.891700 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:16.892481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:16.892916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:17.024658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:17.032329 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:17.033848 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:17.034993 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cbd97dc4-b691-4b9b-924f-4bd15eba0890 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.154349 Jan 11 14:20:17.035565 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 529/1035] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:16 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:20:17.726245 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-79d494d7-e8b5-4bbe-9f41-139e068befcb tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:17.726948 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-79d494d7-e8b5-4bbe-9f41-139e068befcb tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:17.733261 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79d494d7-e8b5-4bbe-9f41-139e068befcb tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:17.733712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79d494d7-e8b5-4bbe-9f41-139e068befcb tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:17.734498 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79d494d7-e8b5-4bbe-9f41-139e068befcb tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:17.735605 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-79d494d7-e8b5-4bbe-9f41-139e068befcb tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:17.878848 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-79d494d7-e8b5-4bbe-9f41-139e068befcb tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:17.886465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-79d494d7-e8b5-4bbe-9f41-139e068befcb tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.164276 Jan 11 14:20:17.887023 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 507/1036] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:17 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:18.054144 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:18.054673 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:18.060969 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:18.061411 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:18.062189 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:18.062622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:18.190122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:18.197883 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:18.199694 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:18.200902 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e246f626-2081-4581-acea-cc58ffba063b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.150551 Jan 11 14:20:18.201454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 530/1037] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:18 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:18.902871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9705efe5-e78c-417f-8722-dbaa86e97191 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:18.903611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9705efe5-e78c-417f-8722-dbaa86e97191 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:18.910196 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9705efe5-e78c-417f-8722-dbaa86e97191 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:18.910744 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9705efe5-e78c-417f-8722-dbaa86e97191 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:18.911564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9705efe5-e78c-417f-8722-dbaa86e97191 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:18.911996 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9705efe5-e78c-417f-8722-dbaa86e97191 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:19.218245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:19.218858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:19.225890 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:19.226344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:19.227154 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:19.227615 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:19.319868 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9705efe5-e78c-417f-8722-dbaa86e97191 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:19.330610 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9705efe5-e78c-417f-8722-dbaa86e97191 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.431175 Jan 11 14:20:19.331645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 508/1038] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:18 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:19.391254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:19.399452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:19.401061 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:19.402368 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6a8834b6-064d-4497-b9f0-931c6815072d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 200 len: 1720 microversion: 2.20 time: 0.188015 Jan 11 14:20:19.405087 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 531/1039] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:19 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:20:19.623775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-17b11e61-a05f-4e1a-890a-3e9a1d1305f5 req-fddd93b6-9cf5-4638-8c9b-d64056597f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07361687-ec7a-4f6e-8e42-530c1a64ba04", "name": "network-vif-deleted", "tag": "c51643c6-7fc4-41fe-bb8c-e237ddadcdaf"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:19.626287 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:20:19.626287 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:20:19.635440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-17b11e61-a05f-4e1a-890a-3e9a1d1305f5 req-fddd93b6-9cf5-4638-8c9b-d64056597f0f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:19.636821 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-17b11e61-a05f-4e1a-890a-3e9a1d1305f5 req-fddd93b6-9cf5-4638-8c9b-d64056597f0f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:19.649797 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-17b11e61-a05f-4e1a-890a-3e9a1d1305f5 req-fddd93b6-9cf5-4638-8c9b-d64056597f0f service nova] Creating event network-vif-deleted:c51643c6-7fc4-41fe-bb8c-e237ddadcdaf for instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 on hv-cinder-82413 Jan 11 14:20:19.656511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-17b11e61-a05f-4e1a-890a-3e9a1d1305f5 req-fddd93b6-9cf5-4638-8c9b-d64056597f0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036206 Jan 11 14:20:19.657320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 509/1040] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:20:20.348504 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-292e0846-984c-4b25-9840-f32d2a8dee18 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:20.349123 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-292e0846-984c-4b25-9840-f32d2a8dee18 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:20.355710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-292e0846-984c-4b25-9840-f32d2a8dee18 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:20.356170 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-292e0846-984c-4b25-9840-f32d2a8dee18 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:20.356965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-292e0846-984c-4b25-9840-f32d2a8dee18 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:20.357399 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-292e0846-984c-4b25-9840-f32d2a8dee18 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:20.421403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:20.422048 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:20.428567 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:20.429207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:20.430220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:20.430861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:20.445061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] HTTP exception thrown: Instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 could not be found. Jan 11 14:20:20.445526 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Returning 404 to user: Instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:20:20.446547 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-025e23cc-8330-4afb-8579-9222c8252625 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 404 len: 111 microversion: 2.20 time: 0.029274 Jan 11 14:20:20.447100 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 510/1041] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:20 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:20:20.457002 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cfcd8ab4-56c9-4fb9-aa87-3cce6f668ae9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '.version_select at 0x7fba95dd9940>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:20.478028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cfcd8ab4-56c9-4fb9-aa87-3cce6f668ae9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717146029" status: 204 len: 0 microversion: 2.20 time: 0.025317 Jan 11 14:20:20.479150 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 511/1042] 10.222.0.49 () {60 vars in 1258 bytes} [Tue Jan 11 14:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717146029 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 14:20:20.549446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-292e0846-984c-4b25-9840-f32d2a8dee18 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:20.557593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-292e0846-984c-4b25-9840-f32d2a8dee18 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.213377 Jan 11 14:20:20.568305 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 532/1043] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:20 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:21.245869 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ba9f9adb-1b88-4450-9017-82f93ff7075c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'create', calling method: .version_select at 0x7fba91286dc0>, body: {"keypair": {"name": "tempest-keypair-2010323018"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:21.261041 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-ba9f9adb-1b88-4450-9017-82f93ff7075c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:20:21.264838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-ba9f9adb-1b88-4450-9017-82f93ff7075c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for user 505b3b6c502d4deea89170e2dba2a029 and project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:20:21.440008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-ba9f9adb-1b88-4450-9017-82f93ff7075c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:20:21.443673 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-ba9f9adb-1b88-4450-9017-82f93ff7075c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for user 505b3b6c502d4deea89170e2dba2a029 and project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:20:21.456439 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ba9f9adb-1b88-4450-9017-82f93ff7075c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.214516 Jan 11 14:20:21.457021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 512/1044] 10.222.0.49 () {62 vars in 1198 bytes} [Tue Jan 11 14:20:21 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 11 14:20:21.574951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c03e3d59-c006-4dcb-bbb2-971f0b815774 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:21.575669 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c03e3d59-c006-4dcb-bbb2-971f0b815774 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:21.582661 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c03e3d59-c006-4dcb-bbb2-971f0b815774 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:21.583341 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c03e3d59-c006-4dcb-bbb2-971f0b815774 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:21.585100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c03e3d59-c006-4dcb-bbb2-971f0b815774 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:21.585733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c03e3d59-c006-4dcb-bbb2-971f0b815774 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:21.761721 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c03e3d59-c006-4dcb-bbb2-971f0b815774 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:21.770130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c03e3d59-c006-4dcb-bbb2-971f0b815774 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.199300 Jan 11 14:20:21.771418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 533/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:21 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:22.755620 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1052251990", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63c4d627-31e2-452f-a693-3a2f1117c04e"}], "security_groups": [{"name": "tempest-securitygroup--1284070781"}], "key_name": "tempest-keypair-2010323018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:22.787117 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a829ed89-a4c3-4514-9bfb-87aee9a5e0f6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:22.788376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a829ed89-a4c3-4514-9bfb-87aee9a5e0f6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:22.794804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a829ed89-a4c3-4514-9bfb-87aee9a5e0f6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:22.795442 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a829ed89-a4c3-4514-9bfb-87aee9a5e0f6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:22.796440 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a829ed89-a4c3-4514-9bfb-87aee9a5e0f6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:22.797439 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a829ed89-a4c3-4514-9bfb-87aee9a5e0f6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:22.899066 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] validate_networks() for [('63c4d627-31e2-452f-a693-3a2f1117c04e', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:20:23.051510 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a829ed89-a4c3-4514-9bfb-87aee9a5e0f6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:23.060111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a829ed89-a4c3-4514-9bfb-87aee9a5e0f6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1756 microversion: 2.1 time: 0.276529 Jan 11 14:20:23.060690 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 534/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:22 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1756 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:23.330162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:20:23.330585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:20:23.331060 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:20:23.331469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:20:23.331938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:20:23.340306 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:23.340752 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:23.341556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:23.341986 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:23.358915 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:20:23.363468 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Getting quotas for user 505b3b6c502d4deea89170e2dba2a029 and project 0e53c79af2d940ce87ec727feef0f0ee. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:20:23.374351 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:20:23.377312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:20:23.421382 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8e4ebac8-3015-46e2-980e-f0cc26d73db6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.670086 Jan 11 14:20:23.422522 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 513/1047] 10.222.0.49 () {62 vars in 1187 bytes} [Tue Jan 11 14:20:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 11 14:20:23.432359 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9027e046-fc3f-4c5e-bbc4-af53a5c3c88d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:23.432970 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9027e046-fc3f-4c5e-bbc4-af53a5c3c88d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:23.485931 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9027e046-fc3f-4c5e-bbc4-af53a5c3c88d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:23.492613 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9027e046-fc3f-4c5e-bbc4-af53a5c3c88d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:23.494122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9027e046-fc3f-4c5e-bbc4-af53a5c3c88d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:23.495210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9027e046-fc3f-4c5e-bbc4-af53a5c3c88d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1282 microversion: 2.20 time: 0.066612 Jan 11 14:20:23.495951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 535/1048] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:23 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:24.080492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-bde51b2c-44fd-41e9-8803-d40cfece6b0c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:24.081098 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-bde51b2c-44fd-41e9-8803-d40cfece6b0c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:24.086960 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bde51b2c-44fd-41e9-8803-d40cfece6b0c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:24.087409 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bde51b2c-44fd-41e9-8803-d40cfece6b0c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:24.088221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bde51b2c-44fd-41e9-8803-d40cfece6b0c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:24.088657 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bde51b2c-44fd-41e9-8803-d40cfece6b0c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:24.232033 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-bde51b2c-44fd-41e9-8803-d40cfece6b0c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:24.239765 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-bde51b2c-44fd-41e9-8803-d40cfece6b0c tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1759 microversion: 2.1 time: 0.164031 Jan 11 14:20:24.240335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 514/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:20:24 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:24.512922 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:24.513626 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:24.521452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:24.521897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:24.522670 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:24.523104 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:24.582539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:24.590680 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:24.592263 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:24.593362 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f947b7cc-3459-46e4-91c1-16767cd3e1fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1340 microversion: 2.20 time: 0.084220 Jan 11 14:20:24.593962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 536/1050] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:24 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1340 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:25.612706 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:25.613331 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:25.619715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:25.620170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:25.620955 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:25.621385 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:25.644333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-8867bfba-b686-4703-9193-b490985c8120 req-f9e2a9fa-af2f-44a8-8fd8-26d0bc102030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a120e67-9697-421a-a7ab-8d249487dc97", "tag": "f98a27e9-7200-41e6-947a-d46ac07ecfd5"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:25.646512 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:20:25.646512 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:20:25.659878 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-8867bfba-b686-4703-9193-b490985c8120 req-f9e2a9fa-af2f-44a8-8fd8-26d0bc102030 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:25.660318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-8867bfba-b686-4703-9193-b490985c8120 req-f9e2a9fa-af2f-44a8-8fd8-26d0bc102030 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:25.686400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-8867bfba-b686-4703-9193-b490985c8120 req-f9e2a9fa-af2f-44a8-8fd8-26d0bc102030 service nova] Creating event network-changed:f98a27e9-7200-41e6-947a-d46ac07ecfd5 for instance 3a120e67-9697-421a-a7ab-8d249487dc97 on hv-cinder-82413 Jan 11 14:20:25.692510 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-8867bfba-b686-4703-9193-b490985c8120 req-f9e2a9fa-af2f-44a8-8fd8-26d0bc102030 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051783 Jan 11 14:20:25.693616 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 537/1051] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:20:25.799607 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:25.808124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:25.810140 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:25.811484 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6fb45669-cebe-403b-8462-b5390968da87 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1408 microversion: 2.20 time: 0.203163 Jan 11 14:20:25.813114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 515/1052] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:25 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:26.831442 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:26.832162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:26.838165 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:26.838609 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:26.839375 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:26.839831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:26.972365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:26.980122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:26.981642 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:26.982743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d1c099b6-ef26-4e1e-b6e6-ee7ae267f104 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1408 microversion: 2.20 time: 0.156280 Jan 11 14:20:26.983290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 538/1053] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:26 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:27.339856 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:20:27.340062 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:20:27.999725 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:28.000741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:28.006931 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:28.007378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:28.008201 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:28.008633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:28.138224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:28.146404 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:28.147930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:28.149018 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1215f227-742e-459f-bae3-bc379e38ef50 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1408 microversion: 2.20 time: 0.153156 Jan 11 14:20:28.149561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 516/1054] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:27 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:29.166541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:29.167168 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:29.173934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:29.174376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:29.175148 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:29.175603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:29.305857 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:29.314350 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:29.315907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:29.316995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1b77bfb4-1ca2-4434-bf3f-a251cd4f3b06 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1408 microversion: 2.20 time: 0.154176 Jan 11 14:20:29.317544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 539/1055] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:29 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:30.335226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:30.335849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:30.342065 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:30.342508 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:30.343273 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:30.343728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:30.469293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:30.476966 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:30.478465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:30.479577 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ecc8a29d-c240-4e72-9ab9-5ae98092fe96 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1408 microversion: 2.20 time: 0.148055 Jan 11 14:20:30.480124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 517/1056] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:30 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:31.411410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-f1af664a-880f-4f6e-be6e-92c9fc338fb4 req-8c2a40b3-5040-46c7-b517-6e4f68e21224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a120e67-9697-421a-a7ab-8d249487dc97", "name": "network-vif-plugged", "status": "completed", "tag": "f98a27e9-7200-41e6-947a-d46ac07ecfd5"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:31.413003 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:20:31.413003 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:20:31.420708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-f1af664a-880f-4f6e-be6e-92c9fc338fb4 req-8c2a40b3-5040-46c7-b517-6e4f68e21224 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:31.421168 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-f1af664a-880f-4f6e-be6e-92c9fc338fb4 req-8c2a40b3-5040-46c7-b517-6e4f68e21224 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:31.434052 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-f1af664a-880f-4f6e-be6e-92c9fc338fb4 req-8c2a40b3-5040-46c7-b517-6e4f68e21224 service nova] Creating event network-vif-plugged:f98a27e9-7200-41e6-947a-d46ac07ecfd5 for instance 3a120e67-9697-421a-a7ab-8d249487dc97 on hv-cinder-82413 Jan 11 14:20:31.439084 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-f1af664a-880f-4f6e-be6e-92c9fc338fb4 req-8c2a40b3-5040-46c7-b517-6e4f68e21224 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Jan 11 14:20:31.439691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 540/1057] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:20:31.497210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:31.497897 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:31.504639 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:31.505089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:31.505873 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:31.506302 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:31.638123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:31.646359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:31.647889 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:31.648980 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-37bf2d3c-4c88-47ff-bbb8-50d99b7e3873 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1408 microversion: 2.20 time: 0.155696 Jan 11 14:20:31.649928 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 518/1058] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:31 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:32.667418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:32.668165 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:32.675185 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:32.675656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:32.676427 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:32.676857 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:32.807281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:32.814934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:32.816475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:32.817574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9af48530-f26c-4836-ab68-392521e3b0fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1408 microversion: 2.20 time: 0.154200 Jan 11 14:20:32.818114 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 541/1059] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:32 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:33.835216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:33.835847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:33.842018 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:33.842461 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:33.843238 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:33.843703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:33.970154 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:33.977723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:33.979219 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:20:33.980385 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cfc2e608-a2ee-4c42-84ac-ec94ae11a1cd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1599 microversion: 2.20 time: 0.148873 Jan 11 14:20:33.980931 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 519/1060] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:20:33 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:20:33.997842 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bdcbfca3-1a73-4a8d-8eb9-01d5659b225a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:20:33.998337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bdcbfca3-1a73-4a8d-8eb9-01d5659b225a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:34.004630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdcbfca3-1a73-4a8d-8eb9-01d5659b225a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:34.005079 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdcbfca3-1a73-4a8d-8eb9-01d5659b225a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:34.005864 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdcbfca3-1a73-4a8d-8eb9-01d5659b225a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:34.006300 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bdcbfca3-1a73-4a8d-8eb9-01d5659b225a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:34.082363 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bdcbfca3-1a73-4a8d-8eb9-01d5659b225a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088148 Jan 11 14:20:34.082950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 542/1061] 10.222.0.49 () {60 vars in 1315 bytes} [Tue Jan 11 14:20:33 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:20:34.998104 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-59488953-95df-4e93-8749-dfce2cd9bdeb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:34.999078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-59488953-95df-4e93-8749-dfce2cd9bdeb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:35.001073 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-b2ad3c47-f918-444e-8a4d-ed27c7e62e76 req-ed25071a-3046-4296-b701-c52fd859aea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a120e67-9697-421a-a7ab-8d249487dc97", "tag": "f98a27e9-7200-41e6-947a-d46ac07ecfd5"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:35.002765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:20:35.002765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:20:35.005741 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-59488953-95df-4e93-8749-dfce2cd9bdeb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:35.006189 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-59488953-95df-4e93-8749-dfce2cd9bdeb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:35.007066 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-59488953-95df-4e93-8749-dfce2cd9bdeb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:35.007542 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-59488953-95df-4e93-8749-dfce2cd9bdeb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:35.010746 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b2ad3c47-f918-444e-8a4d-ed27c7e62e76 req-ed25071a-3046-4296-b701-c52fd859aea5 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:35.011259 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b2ad3c47-f918-444e-8a4d-ed27c7e62e76 req-ed25071a-3046-4296-b701-c52fd859aea5 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:35.022475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-b2ad3c47-f918-444e-8a4d-ed27c7e62e76 req-ed25071a-3046-4296-b701-c52fd859aea5 service nova] Creating event network-changed:f98a27e9-7200-41e6-947a-d46ac07ecfd5 for instance 3a120e67-9697-421a-a7ab-8d249487dc97 on hv-cinder-82413 Jan 11 14:20:35.028299 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-b2ad3c47-f918-444e-8a4d-ed27c7e62e76 req-ed25071a-3046-4296-b701-c52fd859aea5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031016 Jan 11 14:20:35.029299 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 543/1062] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:20:35.073999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-59488953-95df-4e93-8749-dfce2cd9bdeb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.079378 Jan 11 14:20:35.075046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 520/1063] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:34 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:36.085984 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-33a527eb-fdca-479e-be9f-4bca61c07d05 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:36.086986 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-33a527eb-fdca-479e-be9f-4bca61c07d05 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:36.093213 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-33a527eb-fdca-479e-be9f-4bca61c07d05 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:36.094335 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-33a527eb-fdca-479e-be9f-4bca61c07d05 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:36.095121 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-33a527eb-fdca-479e-be9f-4bca61c07d05 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:36.095589 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-33a527eb-fdca-479e-be9f-4bca61c07d05 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:36.162441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-33a527eb-fdca-479e-be9f-4bca61c07d05 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.080527 Jan 11 14:20:36.163086 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 544/1064] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:36 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:37.174342 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0f9c2528-65d5-41d5-bf83-c7c54425cfd1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:37.175335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0f9c2528-65d5-41d5-bf83-c7c54425cfd1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:37.182123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f9c2528-65d5-41d5-bf83-c7c54425cfd1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:37.182575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f9c2528-65d5-41d5-bf83-c7c54425cfd1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:37.183375 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f9c2528-65d5-41d5-bf83-c7c54425cfd1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:37.183841 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0f9c2528-65d5-41d5-bf83-c7c54425cfd1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:37.249067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0f9c2528-65d5-41d5-bf83-c7c54425cfd1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.079318 Jan 11 14:20:37.249684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 521/1065] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:37 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:38.260452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6d35e53e-7087-4e4e-8175-975496ed6e32 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:38.261403 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6d35e53e-7087-4e4e-8175-975496ed6e32 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:38.268289 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6d35e53e-7087-4e4e-8175-975496ed6e32 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:38.268753 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6d35e53e-7087-4e4e-8175-975496ed6e32 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:38.269536 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6d35e53e-7087-4e4e-8175-975496ed6e32 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:38.269975 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6d35e53e-7087-4e4e-8175-975496ed6e32 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:38.334980 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6d35e53e-7087-4e4e-8175-975496ed6e32 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.078590 Jan 11 14:20:38.335804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 545/1066] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:38 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:39.346295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-78ed7af9-4ec5-4a4c-b7f6-86c9775d77ae tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:39.347214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-78ed7af9-4ec5-4a4c-b7f6-86c9775d77ae tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:39.353968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-78ed7af9-4ec5-4a4c-b7f6-86c9775d77ae tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:39.354418 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-78ed7af9-4ec5-4a4c-b7f6-86c9775d77ae tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:39.355189 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-78ed7af9-4ec5-4a4c-b7f6-86c9775d77ae tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:39.355647 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-78ed7af9-4ec5-4a4c-b7f6-86c9775d77ae tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:39.421840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-78ed7af9-4ec5-4a4c-b7f6-86c9775d77ae tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.079519 Jan 11 14:20:39.422472 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 522/1067] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:39 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:40.433214 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3c7fbc03-e380-47e1-b205-2005f8171129 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:40.434236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3c7fbc03-e380-47e1-b205-2005f8171129 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:40.441081 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3c7fbc03-e380-47e1-b205-2005f8171129 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:40.441531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3c7fbc03-e380-47e1-b205-2005f8171129 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:40.442307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3c7fbc03-e380-47e1-b205-2005f8171129 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:40.442742 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3c7fbc03-e380-47e1-b205-2005f8171129 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:40.512609 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3c7fbc03-e380-47e1-b205-2005f8171129 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.083384 Jan 11 14:20:40.513224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 546/1068] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:40 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:41.524434 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0172e366-d238-4a9f-bda7-9e41637ab0b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:41.525430 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0172e366-d238-4a9f-bda7-9e41637ab0b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:41.532700 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0172e366-d238-4a9f-bda7-9e41637ab0b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:41.533151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0172e366-d238-4a9f-bda7-9e41637ab0b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:41.533931 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0172e366-d238-4a9f-bda7-9e41637ab0b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:41.534370 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0172e366-d238-4a9f-bda7-9e41637ab0b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:41.598537 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0172e366-d238-4a9f-bda7-9e41637ab0b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.078101 Jan 11 14:20:41.599119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 523/1069] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:41 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:42.610174 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d9ad689f-2a9a-4961-8a3b-03958f69547d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:42.611169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d9ad689f-2a9a-4961-8a3b-03958f69547d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:42.618038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d9ad689f-2a9a-4961-8a3b-03958f69547d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:42.618483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d9ad689f-2a9a-4961-8a3b-03958f69547d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:42.619260 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d9ad689f-2a9a-4961-8a3b-03958f69547d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:42.619731 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d9ad689f-2a9a-4961-8a3b-03958f69547d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:42.678563 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d9ad689f-2a9a-4961-8a3b-03958f69547d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.072851 Jan 11 14:20:42.679204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 547/1070] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:42 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:43.690061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a2357698-05dc-4ae3-81f1-1ead7b1ca896 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:43.691049 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a2357698-05dc-4ae3-81f1-1ead7b1ca896 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:43.697811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a2357698-05dc-4ae3-81f1-1ead7b1ca896 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:43.698259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a2357698-05dc-4ae3-81f1-1ead7b1ca896 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:43.699037 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a2357698-05dc-4ae3-81f1-1ead7b1ca896 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:43.699470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a2357698-05dc-4ae3-81f1-1ead7b1ca896 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:43.757950 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a2357698-05dc-4ae3-81f1-1ead7b1ca896 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.071986 Jan 11 14:20:43.758558 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 524/1071] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:43 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:44.769393 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-34e027f0-4224-4851-8941-94b57cc51ad9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:44.770385 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-34e027f0-4224-4851-8941-94b57cc51ad9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:44.777254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34e027f0-4224-4851-8941-94b57cc51ad9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:44.777700 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34e027f0-4224-4851-8941-94b57cc51ad9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:44.778470 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34e027f0-4224-4851-8941-94b57cc51ad9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:44.778899 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-34e027f0-4224-4851-8941-94b57cc51ad9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:44.848092 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-34e027f0-4224-4851-8941-94b57cc51ad9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.082649 Jan 11 14:20:44.848769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 548/1072] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:44 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:45.860103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-54b5eea3-77be-4a2d-8f1d-7d82c4826667 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:45.861105 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-54b5eea3-77be-4a2d-8f1d-7d82c4826667 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:45.868165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54b5eea3-77be-4a2d-8f1d-7d82c4826667 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:45.868614 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54b5eea3-77be-4a2d-8f1d-7d82c4826667 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:45.869396 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54b5eea3-77be-4a2d-8f1d-7d82c4826667 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:45.869834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54b5eea3-77be-4a2d-8f1d-7d82c4826667 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:45.946959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-54b5eea3-77be-4a2d-8f1d-7d82c4826667 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.091406 Jan 11 14:20:45.947600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 525/1073] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:45 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:20:46.958724 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-752b66c3-d053-44af-98a7-fd4c9c2c0353 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:46.959665 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-752b66c3-d053-44af-98a7-fd4c9c2c0353 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:46.966483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-752b66c3-d053-44af-98a7-fd4c9c2c0353 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:46.966931 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-752b66c3-d053-44af-98a7-fd4c9c2c0353 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:46.967735 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-752b66c3-d053-44af-98a7-fd4c9c2c0353 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:46.968169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-752b66c3-d053-44af-98a7-fd4c9c2c0353 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:47.042308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-752b66c3-d053-44af-98a7-fd4c9c2c0353 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 14 microversion: 2.20 time: 0.087612 Jan 11 14:20:47.042909 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 549/1074] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:46 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:20:48.054402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-02e730da-34ea-4465-8e67-996ebafae86a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:48.055414 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-02e730da-34ea-4465-8e67-996ebafae86a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:48.062528 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-02e730da-34ea-4465-8e67-996ebafae86a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:48.063010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-02e730da-34ea-4465-8e67-996ebafae86a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:48.063814 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-02e730da-34ea-4465-8e67-996ebafae86a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:48.064898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-02e730da-34ea-4465-8e67-996ebafae86a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:48.134880 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-02e730da-34ea-4465-8e67-996ebafae86a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 11454 microversion: 2.20 time: 0.084713 Jan 11 14:20:48.135504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 526/1075] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:48 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 11454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:49.147205 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ce64f598-8078-4d87-ab56-272b55df2fa6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:49.148228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ce64f598-8078-4d87-ab56-272b55df2fa6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:49.155094 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce64f598-8078-4d87-ab56-272b55df2fa6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:49.155575 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce64f598-8078-4d87-ab56-272b55df2fa6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:49.156354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce64f598-8078-4d87-ab56-272b55df2fa6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:49.156785 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ce64f598-8078-4d87-ab56-272b55df2fa6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:49.231286 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ce64f598-8078-4d87-ab56-272b55df2fa6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 18356 microversion: 2.20 time: 0.088639 Jan 11 14:20:49.232060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 550/1076] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:49 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 18356 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:50.243038 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2bfd5cf2-2ecc-4894-abfa-0b9eae187fd9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:50.244059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2bfd5cf2-2ecc-4894-abfa-0b9eae187fd9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:50.250862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cf2-2ecc-4894-abfa-0b9eae187fd9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:50.251313 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cf2-2ecc-4894-abfa-0b9eae187fd9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:50.252116 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cf2-2ecc-4894-abfa-0b9eae187fd9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:50.252553 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cf2-2ecc-4894-abfa-0b9eae187fd9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:50.338215 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2bfd5cf2-2ecc-4894-abfa-0b9eae187fd9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 19133 microversion: 2.20 time: 0.099088 Jan 11 14:20:50.338836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 527/1077] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:50 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 19133 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:51.350906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5bfc9cb3-5275-4183-999a-3a7d81ad7783 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:51.351852 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5bfc9cb3-5275-4183-999a-3a7d81ad7783 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:51.358722 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5bfc9cb3-5275-4183-999a-3a7d81ad7783 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:51.359171 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5bfc9cb3-5275-4183-999a-3a7d81ad7783 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:51.359975 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5bfc9cb3-5275-4183-999a-3a7d81ad7783 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:51.360410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5bfc9cb3-5275-4183-999a-3a7d81ad7783 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:51.436836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5bfc9cb3-5275-4183-999a-3a7d81ad7783 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 21519 microversion: 2.20 time: 0.090063 Jan 11 14:20:51.437453 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 551/1078] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:51 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 21519 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:52.448716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-72fdd1e2-302b-40a3-9beb-b606db17d880 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:52.449957 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-72fdd1e2-302b-40a3-9beb-b606db17d880 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:52.456701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72fdd1e2-302b-40a3-9beb-b606db17d880 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:52.457146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72fdd1e2-302b-40a3-9beb-b606db17d880 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:52.457919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72fdd1e2-302b-40a3-9beb-b606db17d880 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:52.458347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-72fdd1e2-302b-40a3-9beb-b606db17d880 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:52.528722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-72fdd1e2-302b-40a3-9beb-b606db17d880 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 23140 microversion: 2.20 time: 0.083974 Jan 11 14:20:52.529324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 528/1079] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:52 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 23140 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:53.540587 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-41a2ed0d-0f24-450f-931d-dfdf1b07abf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:53.541605 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-41a2ed0d-0f24-450f-931d-dfdf1b07abf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:53.548383 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-41a2ed0d-0f24-450f-931d-dfdf1b07abf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:53.548825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-41a2ed0d-0f24-450f-931d-dfdf1b07abf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:53.549600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-41a2ed0d-0f24-450f-931d-dfdf1b07abf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:53.550032 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-41a2ed0d-0f24-450f-931d-dfdf1b07abf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:53.619891 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-41a2ed0d-0f24-450f-931d-dfdf1b07abf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 24039 microversion: 2.20 time: 0.083171 Jan 11 14:20:53.620529 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 552/1080] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:53 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 24039 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:20:54.631924 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dad3be42-1779-4e45-b053-e742f623277e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:54.632920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dad3be42-1779-4e45-b053-e742f623277e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:54.639755 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dad3be42-1779-4e45-b053-e742f623277e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:54.640206 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dad3be42-1779-4e45-b053-e742f623277e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:54.640979 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dad3be42-1779-4e45-b053-e742f623277e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:54.641413 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dad3be42-1779-4e45-b053-e742f623277e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:54.716010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dad3be42-1779-4e45-b053-e742f623277e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 25713 microversion: 2.20 time: 0.087983 Jan 11 14:20:54.716664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 529/1081] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:54 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 25713 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:55.727966 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-69187564-3f3a-4121-a1e6-1f306362c7a1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:55.728965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-69187564-3f3a-4121-a1e6-1f306362c7a1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:55.736092 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69187564-3f3a-4121-a1e6-1f306362c7a1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:55.736544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69187564-3f3a-4121-a1e6-1f306362c7a1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:55.737329 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69187564-3f3a-4121-a1e6-1f306362c7a1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:55.737763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69187564-3f3a-4121-a1e6-1f306362c7a1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:55.812750 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-69187564-3f3a-4121-a1e6-1f306362c7a1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 27012 microversion: 2.20 time: 0.088824 Jan 11 14:20:55.813366 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 553/1082] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:55 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 27012 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:56.825492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-bb0a7f69-ff3f-46d7-9bdd-64a17b1d528c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:56.826487 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-bb0a7f69-ff3f-46d7-9bdd-64a17b1d528c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:56.833779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bb0a7f69-ff3f-46d7-9bdd-64a17b1d528c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:56.834221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bb0a7f69-ff3f-46d7-9bdd-64a17b1d528c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:56.834990 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bb0a7f69-ff3f-46d7-9bdd-64a17b1d528c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:56.835419 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bb0a7f69-ff3f-46d7-9bdd-64a17b1d528c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:56.913577 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-bb0a7f69-ff3f-46d7-9bdd-64a17b1d528c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 27724 microversion: 2.20 time: 0.092203 Jan 11 14:20:56.914226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 530/1083] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:56 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 27724 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:20:57.926131 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4a418622-0b7c-4436-b25b-89e44c41fc1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:57.927165 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4a418622-0b7c-4436-b25b-89e44c41fc1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:57.934023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a418622-0b7c-4436-b25b-89e44c41fc1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:57.934469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a418622-0b7c-4436-b25b-89e44c41fc1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:57.935249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a418622-0b7c-4436-b25b-89e44c41fc1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:57.935793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4a418622-0b7c-4436-b25b-89e44c41fc1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:58.011376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4a418622-0b7c-4436-b25b-89e44c41fc1b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28156 microversion: 2.20 time: 0.089783 Jan 11 14:20:58.012020 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 554/1084] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:57 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28156 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:20:59.025066 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5a3ef4da-6381-406f-b46e-87691c78ab20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:20:59.025066 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5a3ef4da-6381-406f-b46e-87691c78ab20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:20:59.031703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a3ef4da-6381-406f-b46e-87691c78ab20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:59.032151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a3ef4da-6381-406f-b46e-87691c78ab20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:59.033548 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a3ef4da-6381-406f-b46e-87691c78ab20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:20:59.033981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5a3ef4da-6381-406f-b46e-87691c78ab20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:20:59.106009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5a3ef4da-6381-406f-b46e-87691c78ab20 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.086031 Jan 11 14:20:59.106626 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 531/1085] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:20:59 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:00.118274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-335eb5ca-0a04-4cc8-a4db-4432be85c9c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:00.119400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-335eb5ca-0a04-4cc8-a4db-4432be85c9c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:00.125955 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-335eb5ca-0a04-4cc8-a4db-4432be85c9c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:00.126464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-335eb5ca-0a04-4cc8-a4db-4432be85c9c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:00.127272 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-335eb5ca-0a04-4cc8-a4db-4432be85c9c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:00.127741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-335eb5ca-0a04-4cc8-a4db-4432be85c9c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:00.192335 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-335eb5ca-0a04-4cc8-a4db-4432be85c9c3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.078119 Jan 11 14:21:00.196207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 555/1086] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:00 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:01.205278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-efa0aea8-3ebc-4de1-b779-371596204cc3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:01.206298 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-efa0aea8-3ebc-4de1-b779-371596204cc3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:01.213029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-efa0aea8-3ebc-4de1-b779-371596204cc3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:01.213475 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-efa0aea8-3ebc-4de1-b779-371596204cc3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:01.214244 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-efa0aea8-3ebc-4de1-b779-371596204cc3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:01.214706 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-efa0aea8-3ebc-4de1-b779-371596204cc3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:01.281905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-efa0aea8-3ebc-4de1-b779-371596204cc3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.081160 Jan 11 14:21:01.282524 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 532/1087] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:01 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:02.293141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6b4a0e8d-8098-4024-a19b-189756a19257 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:02.294132 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6b4a0e8d-8098-4024-a19b-189756a19257 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:02.300911 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b4a0e8d-8098-4024-a19b-189756a19257 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:02.301355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b4a0e8d-8098-4024-a19b-189756a19257 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:02.302126 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b4a0e8d-8098-4024-a19b-189756a19257 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:02.302560 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b4a0e8d-8098-4024-a19b-189756a19257 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:02.370435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6b4a0e8d-8098-4024-a19b-189756a19257 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.081164 Jan 11 14:21:02.371319 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 556/1088] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:02 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:03.382751 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6cf2b52f-4c51-42f1-b236-681312e18bd8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:03.383691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6cf2b52f-4c51-42f1-b236-681312e18bd8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:03.390514 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6cf2b52f-4c51-42f1-b236-681312e18bd8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:03.390962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6cf2b52f-4c51-42f1-b236-681312e18bd8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:03.391770 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6cf2b52f-4c51-42f1-b236-681312e18bd8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:03.392810 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6cf2b52f-4c51-42f1-b236-681312e18bd8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:03.451333 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6cf2b52f-4c51-42f1-b236-681312e18bd8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.072689 Jan 11 14:21:03.451977 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 533/1089] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:03 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:04.464030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3923cda5-8a5e-41b5-9a61-9813c128f54a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:04.465023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3923cda5-8a5e-41b5-9a61-9813c128f54a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:04.471848 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3923cda5-8a5e-41b5-9a61-9813c128f54a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:04.472297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3923cda5-8a5e-41b5-9a61-9813c128f54a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:04.473103 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3923cda5-8a5e-41b5-9a61-9813c128f54a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:04.473515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3923cda5-8a5e-41b5-9a61-9813c128f54a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:04.532443 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3923cda5-8a5e-41b5-9a61-9813c128f54a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.072505 Jan 11 14:21:04.533078 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 557/1090] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:04 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:05.544452 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2145833f-5fa2-4ca5-bce1-eb78db8d6e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:05.545437 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2145833f-5fa2-4ca5-bce1-eb78db8d6e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:05.552230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2145833f-5fa2-4ca5-bce1-eb78db8d6e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:05.552677 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2145833f-5fa2-4ca5-bce1-eb78db8d6e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:05.553443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2145833f-5fa2-4ca5-bce1-eb78db8d6e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:05.553876 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2145833f-5fa2-4ca5-bce1-eb78db8d6e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:05.614323 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2145833f-5fa2-4ca5-bce1-eb78db8d6e86 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.073834 Jan 11 14:21:05.614975 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 534/1091] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:05 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:06.627544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ab26b3dc-f121-4761-9365-b06169aa84ec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:06.628598 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ab26b3dc-f121-4761-9365-b06169aa84ec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:06.635586 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ab26b3dc-f121-4761-9365-b06169aa84ec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:06.636046 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ab26b3dc-f121-4761-9365-b06169aa84ec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:06.636843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ab26b3dc-f121-4761-9365-b06169aa84ec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:06.637287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ab26b3dc-f121-4761-9365-b06169aa84ec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:06.697813 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ab26b3dc-f121-4761-9365-b06169aa84ec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.074969 Jan 11 14:21:06.698619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 558/1092] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:06 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:07.711139 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-55171b42-5573-43b1-8f17-fd2a5c0485f3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:07.712168 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-55171b42-5573-43b1-8f17-fd2a5c0485f3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:07.718925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55171b42-5573-43b1-8f17-fd2a5c0485f3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:07.719373 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55171b42-5573-43b1-8f17-fd2a5c0485f3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:07.720192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55171b42-5573-43b1-8f17-fd2a5c0485f3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:07.720625 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-55171b42-5573-43b1-8f17-fd2a5c0485f3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:07.784263 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-55171b42-5573-43b1-8f17-fd2a5c0485f3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.077224 Jan 11 14:21:07.784871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 535/1093] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:07 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:08.796184 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c423a02c-bbc3-4df2-a9fa-d1fff2bd342f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:08.797187 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c423a02c-bbc3-4df2-a9fa-d1fff2bd342f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:08.804072 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c423a02c-bbc3-4df2-a9fa-d1fff2bd342f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:08.804523 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c423a02c-bbc3-4df2-a9fa-d1fff2bd342f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:08.805310 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c423a02c-bbc3-4df2-a9fa-d1fff2bd342f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:08.805746 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c423a02c-bbc3-4df2-a9fa-d1fff2bd342f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:08.871563 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c423a02c-bbc3-4df2-a9fa-d1fff2bd342f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.079221 Jan 11 14:21:08.872224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 559/1094] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:08 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:09.884294 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-bc941d8f-701f-4077-9d88-ca25cc02a4b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:09.885278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-bc941d8f-701f-4077-9d88-ca25cc02a4b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:09.892146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bc941d8f-701f-4077-9d88-ca25cc02a4b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:09.892591 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bc941d8f-701f-4077-9d88-ca25cc02a4b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:09.893366 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bc941d8f-701f-4077-9d88-ca25cc02a4b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:09.893798 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bc941d8f-701f-4077-9d88-ca25cc02a4b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:09.957331 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-bc941d8f-701f-4077-9d88-ca25cc02a4b1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.076922 Jan 11 14:21:09.958371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 536/1095] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:09 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:10.970088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9379b821-9a41-4f8e-b037-5c27eb9b6707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:10.971079 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9379b821-9a41-4f8e-b037-5c27eb9b6707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:10.977918 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9379b821-9a41-4f8e-b037-5c27eb9b6707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:10.978362 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9379b821-9a41-4f8e-b037-5c27eb9b6707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:10.979169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9379b821-9a41-4f8e-b037-5c27eb9b6707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:10.979627 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9379b821-9a41-4f8e-b037-5c27eb9b6707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:11.044870 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9379b821-9a41-4f8e-b037-5c27eb9b6707 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.078869 Jan 11 14:21:11.045491 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 560/1096] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:10 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:12.056825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7cf1d57b-95ad-40cb-8c9b-462d93fb84c9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:12.057730 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7cf1d57b-95ad-40cb-8c9b-462d93fb84c9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:12.064533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7cf1d57b-95ad-40cb-8c9b-462d93fb84c9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:12.064987 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7cf1d57b-95ad-40cb-8c9b-462d93fb84c9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:12.065762 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7cf1d57b-95ad-40cb-8c9b-462d93fb84c9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:12.066200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7cf1d57b-95ad-40cb-8c9b-462d93fb84c9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:12.136655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7cf1d57b-95ad-40cb-8c9b-462d93fb84c9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28215 microversion: 2.20 time: 0.083916 Jan 11 14:21:12.137274 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 537/1097] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:12 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:13.148384 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2ee0967d-1712-46f9-b690-14a77ac59d6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:13.149444 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2ee0967d-1712-46f9-b690-14a77ac59d6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:13.156245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2ee0967d-1712-46f9-b690-14a77ac59d6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:13.156702 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2ee0967d-1712-46f9-b690-14a77ac59d6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:13.157485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2ee0967d-1712-46f9-b690-14a77ac59d6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:13.157922 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2ee0967d-1712-46f9-b690-14a77ac59d6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:13.244308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2ee0967d-1712-46f9-b690-14a77ac59d6a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28342 microversion: 2.20 time: 0.099869 Jan 11 14:21:13.244942 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 561/1098] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:13 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:21:14.256575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-32bc16af-eaf1-4c32-8077-9a6659ae0cfa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:14.257571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-32bc16af-eaf1-4c32-8077-9a6659ae0cfa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:14.264379 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32bc16af-eaf1-4c32-8077-9a6659ae0cfa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:14.264829 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32bc16af-eaf1-4c32-8077-9a6659ae0cfa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:14.265600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32bc16af-eaf1-4c32-8077-9a6659ae0cfa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:14.266032 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32bc16af-eaf1-4c32-8077-9a6659ae0cfa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:14.346224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-32bc16af-eaf1-4c32-8077-9a6659ae0cfa tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28506 microversion: 2.20 time: 0.094141 Jan 11 14:21:14.347106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 538/1099] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:14 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28506 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:21:15.358081 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5c440444-1246-45a2-91e8-a3a5c41950fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:15.358998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5c440444-1246-45a2-91e8-a3a5c41950fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:15.366507 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5c440444-1246-45a2-91e8-a3a5c41950fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:15.366951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5c440444-1246-45a2-91e8-a3a5c41950fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:15.367762 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5c440444-1246-45a2-91e8-a3a5c41950fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:15.368197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5c440444-1246-45a2-91e8-a3a5c41950fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:15.450222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5c440444-1246-45a2-91e8-a3a5c41950fc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.095936 Jan 11 14:21:15.451547 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 562/1100] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:15 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:16.462062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2d1e2a5d-8e32-4305-a4e2-4492e75226c6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:16.463106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2d1e2a5d-8e32-4305-a4e2-4492e75226c6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:16.470124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2d1e2a5d-8e32-4305-a4e2-4492e75226c6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:16.470580 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2d1e2a5d-8e32-4305-a4e2-4492e75226c6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:16.471509 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2d1e2a5d-8e32-4305-a4e2-4492e75226c6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:16.471962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2d1e2a5d-8e32-4305-a4e2-4492e75226c6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:16.533330 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2d1e2a5d-8e32-4305-a4e2-4492e75226c6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.075288 Jan 11 14:21:16.533956 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 539/1101] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:16 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:17.545449 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-97b4eaae-c5e0-4b4f-9f5d-81aca93c1da6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:17.546476 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-97b4eaae-c5e0-4b4f-9f5d-81aca93c1da6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:17.553269 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97b4eaae-c5e0-4b4f-9f5d-81aca93c1da6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:17.553714 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97b4eaae-c5e0-4b4f-9f5d-81aca93c1da6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:17.554482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97b4eaae-c5e0-4b4f-9f5d-81aca93c1da6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:17.554945 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97b4eaae-c5e0-4b4f-9f5d-81aca93c1da6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:17.614209 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-97b4eaae-c5e0-4b4f-9f5d-81aca93c1da6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.072671 Jan 11 14:21:17.614823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 563/1102] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:17 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:18.626216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d3c93311-d6fe-442a-8f83-88f05ae31b68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:18.627207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d3c93311-d6fe-442a-8f83-88f05ae31b68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:18.634067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3c93311-d6fe-442a-8f83-88f05ae31b68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:18.634512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3c93311-d6fe-442a-8f83-88f05ae31b68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:18.635280 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3c93311-d6fe-442a-8f83-88f05ae31b68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:18.635744 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3c93311-d6fe-442a-8f83-88f05ae31b68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:18.701212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d3c93311-d6fe-442a-8f83-88f05ae31b68 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.078705 Jan 11 14:21:18.702281 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 540/1103] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:18 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:19.714353 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-dfd0e6dd-e156-42a9-bbf1-b3e62e1a4cc2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:19.715352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-dfd0e6dd-e156-42a9-bbf1-b3e62e1a4cc2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:19.722163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dfd0e6dd-e156-42a9-bbf1-b3e62e1a4cc2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:19.723172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dfd0e6dd-e156-42a9-bbf1-b3e62e1a4cc2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:19.723970 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dfd0e6dd-e156-42a9-bbf1-b3e62e1a4cc2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:19.724400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dfd0e6dd-e156-42a9-bbf1-b3e62e1a4cc2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:19.785292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-dfd0e6dd-e156-42a9-bbf1-b3e62e1a4cc2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.074367 Jan 11 14:21:19.785924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 564/1104] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:19 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:20.796637 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8b0e7ed2-6ea6-4c07-83de-648d9b36dfa5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:20.797645 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8b0e7ed2-6ea6-4c07-83de-648d9b36dfa5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:20.805000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8b0e7ed2-6ea6-4c07-83de-648d9b36dfa5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:20.805450 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8b0e7ed2-6ea6-4c07-83de-648d9b36dfa5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:20.806228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8b0e7ed2-6ea6-4c07-83de-648d9b36dfa5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:20.806666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8b0e7ed2-6ea6-4c07-83de-648d9b36dfa5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:20.869959 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8b0e7ed2-6ea6-4c07-83de-648d9b36dfa5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.077240 Jan 11 14:21:20.870809 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 541/1105] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:20 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:21.882525 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f582451d-d4cb-4a74-8590-82c84b23c284 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:21.883536 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f582451d-d4cb-4a74-8590-82c84b23c284 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:21.890305 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f582451d-d4cb-4a74-8590-82c84b23c284 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:21.890751 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f582451d-d4cb-4a74-8590-82c84b23c284 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:21.891541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f582451d-d4cb-4a74-8590-82c84b23c284 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:21.891976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f582451d-d4cb-4a74-8590-82c84b23c284 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:21.950836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f582451d-d4cb-4a74-8590-82c84b23c284 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.072813 Jan 11 14:21:21.951446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 565/1106] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:21 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:22.263067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-14ca61e0-c2e7-44f3-80e1-82bf7080dbc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:22.264131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-14ca61e0-c2e7-44f3-80e1-82bf7080dbc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:22.270924 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-14ca61e0-c2e7-44f3-80e1-82bf7080dbc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:22.271377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-14ca61e0-c2e7-44f3-80e1-82bf7080dbc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:22.272216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-14ca61e0-c2e7-44f3-80e1-82bf7080dbc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:22.272655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-14ca61e0-c2e7-44f3-80e1-82bf7080dbc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:22.303240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-14ca61e0-c2e7-44f3-80e1-82bf7080dbc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044237 Jan 11 14:21:22.303849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 542/1107] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:21:22 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:21:22.365747 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4ba298ff-7324-4c47-b66c-bd2c6f3045be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:22.366338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4ba298ff-7324-4c47-b66c-bd2c6f3045be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:22.373248 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4ba298ff-7324-4c47-b66c-bd2c6f3045be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:22.373699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4ba298ff-7324-4c47-b66c-bd2c6f3045be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:22.374475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4ba298ff-7324-4c47-b66c-bd2c6f3045be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:22.374917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4ba298ff-7324-4c47-b66c-bd2c6f3045be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:22.401399 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4ba298ff-7324-4c47-b66c-bd2c6f3045be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:21:22.472452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4ba298ff-7324-4c47-b66c-bd2c6f3045be tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 204 len: 0 microversion: 2.1 time: 0.110984 Jan 11 14:21:22.473377 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 566/1108] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:21:22 2022] DELETE /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:21:22.483236 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b8ad6f50-f259-41f8-8cb6-3897d18168ed tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:22.483890 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b8ad6f50-f259-41f8-8cb6-3897d18168ed tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:22.490399 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f50-f259-41f8-8cb6-3897d18168ed tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:22.490856 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f50-f259-41f8-8cb6-3897d18168ed tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:22.491691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f50-f259-41f8-8cb6-3897d18168ed tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:22.492134 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f50-f259-41f8-8cb6-3897d18168ed tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:22.623991 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b8ad6f50-f259-41f8-8cb6-3897d18168ed tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:22.631162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b8ad6f50-f259-41f8-8cb6-3897d18168ed tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1673 microversion: 2.1 time: 0.153262 Jan 11 14:21:22.631745 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 543/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:22 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:22.963476 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-06f3dd7d-e0be-4465-abf4-e23bd5f8b62b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:22.964522 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-06f3dd7d-e0be-4465-abf4-e23bd5f8b62b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:22.970682 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-06f3dd7d-e0be-4465-abf4-e23bd5f8b62b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:22.971125 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-06f3dd7d-e0be-4465-abf4-e23bd5f8b62b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:22.971918 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-06f3dd7d-e0be-4465-abf4-e23bd5f8b62b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:22.972349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-06f3dd7d-e0be-4465-abf4-e23bd5f8b62b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:23.033744 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-06f3dd7d-e0be-4465-abf4-e23bd5f8b62b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.074272 Jan 11 14:21:23.034361 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 567/1110] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:22 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:23.648383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-36ba055a-552c-46e8-99ac-14fb744a23a8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:23.649112 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-36ba055a-552c-46e8-99ac-14fb744a23a8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:23.655317 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36ba055a-552c-46e8-99ac-14fb744a23a8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:23.655807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36ba055a-552c-46e8-99ac-14fb744a23a8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:23.656590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36ba055a-552c-46e8-99ac-14fb744a23a8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:23.657031 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36ba055a-552c-46e8-99ac-14fb744a23a8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:23.783295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-36ba055a-552c-46e8-99ac-14fb744a23a8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:23.791088 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-36ba055a-552c-46e8-99ac-14fb744a23a8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1673 microversion: 2.1 time: 0.146397 Jan 11 14:21:23.791751 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 544/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:23 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:24.046597 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9b1c4f0c-84f1-4821-b9f2-bec912fdc3e7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:24.047180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9b1c4f0c-84f1-4821-b9f2-bec912fdc3e7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:24.055180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9b1c4f0c-84f1-4821-b9f2-bec912fdc3e7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:24.055667 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9b1c4f0c-84f1-4821-b9f2-bec912fdc3e7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:24.056473 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9b1c4f0c-84f1-4821-b9f2-bec912fdc3e7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:24.056912 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9b1c4f0c-84f1-4821-b9f2-bec912fdc3e7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:24.121549 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9b1c4f0c-84f1-4821-b9f2-bec912fdc3e7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.079571 Jan 11 14:21:24.125430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 568/1112] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:24 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:24.754754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-c069bf0c-1cff-4d66-b4bd-2706606b48c1 req-5cc66119-0daa-4061-b21a-51f1826ea43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da33a406-0839-4a04-9800-1444f9ae0b82", "name": "network-vif-deleted", "tag": "4d8257f7-0bfc-4ec4-85ba-6f20d746300d"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:24.756445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:21:24.756445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:21:24.764053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-c069bf0c-1cff-4d66-b4bd-2706606b48c1 req-5cc66119-0daa-4061-b21a-51f1826ea43f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:24.764496 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-c069bf0c-1cff-4d66-b4bd-2706606b48c1 req-5cc66119-0daa-4061-b21a-51f1826ea43f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:24.775907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-c069bf0c-1cff-4d66-b4bd-2706606b48c1 req-5cc66119-0daa-4061-b21a-51f1826ea43f service nova] Creating event network-vif-deleted:4d8257f7-0bfc-4ec4-85ba-6f20d746300d for instance da33a406-0839-4a04-9800-1444f9ae0b82 on hv-cinder-82413 Jan 11 14:21:24.781077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-c069bf0c-1cff-4d66-b4bd-2706606b48c1 req-5cc66119-0daa-4061-b21a-51f1826ea43f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030602 Jan 11 14:21:24.781715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 545/1113] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:21:24.810249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5d874148-7a47-44d8-9d30-13a15c98b4b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:24.811266 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5d874148-7a47-44d8-9d30-13a15c98b4b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:24.819186 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5d874148-7a47-44d8-9d30-13a15c98b4b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:24.819872 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5d874148-7a47-44d8-9d30-13a15c98b4b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:24.820913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5d874148-7a47-44d8-9d30-13a15c98b4b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:24.821418 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5d874148-7a47-44d8-9d30-13a15c98b4b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:24.900778 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5d874148-7a47-44d8-9d30-13a15c98b4b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:24.908653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5d874148-7a47-44d8-9d30-13a15c98b4b3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 200 len: 1322 microversion: 2.1 time: 0.103852 Jan 11 14:21:24.909236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 569/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:24 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 1322 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:25.133295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dd3c7b24-3f8b-4035-b499-571cf31c0d77 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:25.134265 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dd3c7b24-3f8b-4035-b499-571cf31c0d77 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:25.140828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd3c7b24-3f8b-4035-b499-571cf31c0d77 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:25.141283 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd3c7b24-3f8b-4035-b499-571cf31c0d77 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:25.142104 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd3c7b24-3f8b-4035-b499-571cf31c0d77 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:25.142544 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd3c7b24-3f8b-4035-b499-571cf31c0d77 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:25.212559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dd3c7b24-3f8b-4035-b499-571cf31c0d77 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.083222 Jan 11 14:21:25.213230 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 546/1115] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:25 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:25.925637 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:25.926235 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:25.932419 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:25.932866 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:25.933667 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:25.934093 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:25.947414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] HTTP exception thrown: Instance da33a406-0839-4a04-9800-1444f9ae0b82 could not be found. Jan 11 14:21:25.948019 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Returning 404 to user: Instance da33a406-0839-4a04-9800-1444f9ae0b82 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:21:25.948806 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-57c2a82d-f0b9-42b0-8336-65cfca556993 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 404 len: 111 microversion: 2.1 time: 0.026886 Jan 11 14:21:25.949315 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 570/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:25 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:21:25.958981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-62d8a3a2-4049-47d8-84ef-4a41b607d812 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '.version_select at 0x7fba91395430>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:25.975478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-62d8a3a2-4049-47d8-84ef-4a41b607d812 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242667538" status: 202 len: 0 microversion: 2.1 time: 0.021199 Jan 11 14:21:25.976053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 547/1117] 10.222.0.49 () {58 vars in 1217 bytes} [Tue Jan 11 14:21:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242667538 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:26.224217 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-12b8a947-db5f-4b39-b989-6ddea7f93103 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:26.225033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-12b8a947-db5f-4b39-b989-6ddea7f93103 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:26.231226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-12b8a947-db5f-4b39-b989-6ddea7f93103 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:26.231706 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-12b8a947-db5f-4b39-b989-6ddea7f93103 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:26.232480 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-12b8a947-db5f-4b39-b989-6ddea7f93103 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:26.232914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-12b8a947-db5f-4b39-b989-6ddea7f93103 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:26.292694 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-12b8a947-db5f-4b39-b989-6ddea7f93103 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.072145 Jan 11 14:21:26.296673 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 571/1118] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:26 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:26.592836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:21:26.593026 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:21:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:21:26.634512 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1568c8dd-0b92-481e-8ffc-8e5164ef56c8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'create', calling method: .version_select at 0x7fba95dd9670>, body: {"keypair": {"name": "tempest-keypair-845690865"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:26.648938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-1568c8dd-0b92-481e-8ffc-8e5164ef56c8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for project 3a11f6957ee74ff0a62315613ff54913. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:21:26.652699 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-1568c8dd-0b92-481e-8ffc-8e5164ef56c8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for user 67b016e5f2694c90821eb0eb80e3dc79 and project 3a11f6957ee74ff0a62315613ff54913. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:21:26.737945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-1568c8dd-0b92-481e-8ffc-8e5164ef56c8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for project 3a11f6957ee74ff0a62315613ff54913. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:21:26.741644 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-1568c8dd-0b92-481e-8ffc-8e5164ef56c8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for user 67b016e5f2694c90821eb0eb80e3dc79 and project 3a11f6957ee74ff0a62315613ff54913. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:21:26.754160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1568c8dd-0b92-481e-8ffc-8e5164ef56c8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.123822 Jan 11 14:21:26.754751 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 548/1119] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Jan 11 14:21:26 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:27.304993 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1fb0db5d-f22d-4f4b-8fe5-bf89b4247cf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:27.306074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1fb0db5d-f22d-4f4b-8fe5-bf89b4247cf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:27.312962 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1fb0db5d-f22d-4f4b-8fe5-bf89b4247cf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:27.313512 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1fb0db5d-f22d-4f4b-8fe5-bf89b4247cf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:27.314352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1fb0db5d-f22d-4f4b-8fe5-bf89b4247cf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:27.314786 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1fb0db5d-f22d-4f4b-8fe5-bf89b4247cf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:27.380431 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1fb0db5d-f22d-4f4b-8fe5-bf89b4247cf0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.079288 Jan 11 14:21:27.384471 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 572/1120] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:27 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:27.929789 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b286096d-a1cf-4dbe-9971-43789770232f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1911624153"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:27.930356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b286096d-a1cf-4dbe-9971-43789770232f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:27.936360 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b286096d-a1cf-4dbe-9971-43789770232f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:27.936814 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b286096d-a1cf-4dbe-9971-43789770232f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:27.937601 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b286096d-a1cf-4dbe-9971-43789770232f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:27.938039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b286096d-a1cf-4dbe-9971-43789770232f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:28.073852 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.network.security_group_api [None req-b286096d-a1cf-4dbe-9971-43789770232f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Removing security group 2c5e9284-5045-4583-8aae-d83f9dfe6a7b from port c7e7af63-dba4-40f2-b97e-3dc8a5d14124 Jan 11 14:21:28.121783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1495563894", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b91e79a-b551-4734-8a4b-8bd89379e2e4"}], "security_groups": [{"name": "tempest-securitygroup--1268893354"}], "key_name": "tempest-keypair-845690865", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:28.267556 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] validate_networks() for [('0b91e79a-b551-4734-8a4b-8bd89379e2e4', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:21:28.784434 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b286096d-a1cf-4dbe-9971-43789770232f tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "POST /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/action" status: 202 len: 0 microversion: 2.1 time: 0.859056 Jan 11 14:21:28.784952 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 549/1121] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:27 2022] POST /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:28.790420 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-02aee571-9745-476c-a3b8-9d9a210ea414 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:28.791372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-02aee571-9745-476c-a3b8-9d9a210ea414 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:28.806921 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-02aee571-9745-476c-a3b8-9d9a210ea414 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:28.807447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-02aee571-9745-476c-a3b8-9d9a210ea414 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:28.808284 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-02aee571-9745-476c-a3b8-9d9a210ea414 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:28.808725 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-02aee571-9745-476c-a3b8-9d9a210ea414 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:28.922832 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-02aee571-9745-476c-a3b8-9d9a210ea414 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.135277 Jan 11 14:21:28.925012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 550/1122] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:28 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:28.931747 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-d5be882a-22bc-4c70-b862-5cab32fcb200 req-da8ac440-9449-4c55-ae38-2027a314b105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682faefe-6922-4f9f-b5b8-48b8c9a49665", "tag": "c7e7af63-dba4-40f2-b97e-3dc8a5d14124"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:28.955000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:21:28.955000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:21:28.970907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-d5be882a-22bc-4c70-b862-5cab32fcb200 req-da8ac440-9449-4c55-ae38-2027a314b105 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:28.971716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-d5be882a-22bc-4c70-b862-5cab32fcb200 req-da8ac440-9449-4c55-ae38-2027a314b105 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:28.984662 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-d5be882a-22bc-4c70-b862-5cab32fcb200 req-da8ac440-9449-4c55-ae38-2027a314b105 service nova] Creating event network-changed:c7e7af63-dba4-40f2-b97e-3dc8a5d14124 for instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 on hv-cinder-82413 Jan 11 14:21:28.990669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-d5be882a-22bc-4c70-b862-5cab32fcb200 req-da8ac440-9449-4c55-ae38-2027a314b105 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064023 Jan 11 14:21:28.991846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 551/1123] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:21:29.057543 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:21:29.058001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:21:29.058795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:21:29.059285 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:21:29.059783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:21:29.075856 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:29.079972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:29.081567 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:29.084155 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:29.120793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for project 3a11f6957ee74ff0a62315613ff54913. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:21:29.126647 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Getting quotas for user 67b016e5f2694c90821eb0eb80e3dc79 and project 3a11f6957ee74ff0a62315613ff54913. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:21:29.141785 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:21:29.144442 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:21:29.195398 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-00d973ed-4124-46dc-808c-22ebc0926c74 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.077908 Jan 11 14:21:29.196390 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 573/1124] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:21:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 14:21:29.207241 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d9a4671b-b5f1-46c4-a557-938d935dc133 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:29.207905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d9a4671b-b5f1-46c4-a557-938d935dc133 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:29.262409 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d9a4671b-b5f1-46c4-a557-938d935dc133 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:29.270126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d9a4671b-b5f1-46c4-a557-938d935dc133 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1237 microversion: 2.1 time: 0.067450 Jan 11 14:21:29.270913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 552/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:29 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:29.934793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fe0d5eb9-fd14-4e03-9b33-2bda07eb652c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:29.935831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fe0d5eb9-fd14-4e03-9b33-2bda07eb652c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:29.942280 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fe0d5eb9-fd14-4e03-9b33-2bda07eb652c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:29.942732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fe0d5eb9-fd14-4e03-9b33-2bda07eb652c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:29.943550 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fe0d5eb9-fd14-4e03-9b33-2bda07eb652c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:29.943989 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fe0d5eb9-fd14-4e03-9b33-2bda07eb652c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:30.013995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fe0d5eb9-fd14-4e03-9b33-2bda07eb652c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.082656 Jan 11 14:21:30.014571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 574/1126] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:29 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:30.286498 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e9a832d0-cb01-4ea3-8d7e-6f7b1e9e4be3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:30.288339 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e9a832d0-cb01-4ea3-8d7e-6f7b1e9e4be3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:30.297259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e9a832d0-cb01-4ea3-8d7e-6f7b1e9e4be3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:30.297715 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e9a832d0-cb01-4ea3-8d7e-6f7b1e9e4be3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:30.298538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e9a832d0-cb01-4ea3-8d7e-6f7b1e9e4be3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:30.298982 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e9a832d0-cb01-4ea3-8d7e-6f7b1e9e4be3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:30.359457 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e9a832d0-cb01-4ea3-8d7e-6f7b1e9e4be3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:30.366983 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e9a832d0-cb01-4ea3-8d7e-6f7b1e9e4be3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1295 microversion: 2.1 time: 0.084243 Jan 11 14:21:30.367802 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 553/1127] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:30 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:30.693542 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-778c9cc6-8c74-4972-896e-5296ce602013 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:30.694845 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-778c9cc6-8c74-4972-896e-5296ce602013 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:30.697167 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-3754fa1d-1870-4c53-83a4-1536c2fe8f65 req-4e867e6b-6c24-4d25-9d2d-33bb03a8061d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682faefe-6922-4f9f-b5b8-48b8c9a49665", "tag": "c7e7af63-dba4-40f2-b97e-3dc8a5d14124"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:30.704060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-778c9cc6-8c74-4972-896e-5296ce602013 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:30.704833 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:21:30.704833 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:21:30.705348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-778c9cc6-8c74-4972-896e-5296ce602013 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:30.706630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-778c9cc6-8c74-4972-896e-5296ce602013 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:30.708008 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-778c9cc6-8c74-4972-896e-5296ce602013 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:30.715470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-3754fa1d-1870-4c53-83a4-1536c2fe8f65 req-4e867e6b-6c24-4d25-9d2d-33bb03a8061d service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:30.715935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-3754fa1d-1870-4c53-83a4-1536c2fe8f65 req-4e867e6b-6c24-4d25-9d2d-33bb03a8061d service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:30.728595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-3754fa1d-1870-4c53-83a4-1536c2fe8f65 req-4e867e6b-6c24-4d25-9d2d-33bb03a8061d service nova] Creating event network-changed:c7e7af63-dba4-40f2-b97e-3dc8a5d14124 for instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 on hv-cinder-82413 Jan 11 14:21:30.735899 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-3754fa1d-1870-4c53-83a4-1536c2fe8f65 req-4e867e6b-6c24-4d25-9d2d-33bb03a8061d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042983 Jan 11 14:21:30.737014 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 554/1128] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:21:30.810873 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-778c9cc6-8c74-4972-896e-5296ce602013 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lazy-loading 'services' on Instance uuid 682faefe-6922-4f9f-b5b8-48b8c9a49665 {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:21:30.887066 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-778c9cc6-8c74-4972-896e-5296ce602013 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "DELETE /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments/e932d8c1-a320-4cd4-aa49-babacc2dac6a" status: 202 len: 0 microversion: 2.1 time: 0.200601 Jan 11 14:21:30.892128 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 575/1129] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:21:30 2022] DELETE /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments/e932d8c1-a320-4cd4-aa49-babacc2dac6a => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:30.898930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c0998815-f249-4dff-b228-589ba9e6edcf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:30.900205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c0998815-f249-4dff-b228-589ba9e6edcf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:30.910540 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0998815-f249-4dff-b228-589ba9e6edcf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:30.911353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0998815-f249-4dff-b228-589ba9e6edcf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:30.912694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0998815-f249-4dff-b228-589ba9e6edcf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:30.913377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c0998815-f249-4dff-b228-589ba9e6edcf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:30.953615 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c0998815-f249-4dff-b228-589ba9e6edcf tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058847 Jan 11 14:21:30.954783 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 555/1130] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:21:30 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:21:31.027137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c94723aa-4534-4196-8d35-f0fa7287e989 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:31.029067 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c94723aa-4534-4196-8d35-f0fa7287e989 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:31.035673 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c94723aa-4534-4196-8d35-f0fa7287e989 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:31.036383 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c94723aa-4534-4196-8d35-f0fa7287e989 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:31.037347 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c94723aa-4534-4196-8d35-f0fa7287e989 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:31.037773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c94723aa-4534-4196-8d35-f0fa7287e989 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:31.105218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c94723aa-4534-4196-8d35-f0fa7287e989 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.082720 Jan 11 14:21:31.108445 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 576/1131] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:31 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:31.384565 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-447980c7-1964-40bb-b4cd-b8e822b131af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:31.385823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-447980c7-1964-40bb-b4cd-b8e822b131af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:31.394555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-447980c7-1964-40bb-b4cd-b8e822b131af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:31.395013 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-447980c7-1964-40bb-b4cd-b8e822b131af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:31.395855 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-447980c7-1964-40bb-b4cd-b8e822b131af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:31.421546 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-447980c7-1964-40bb-b4cd-b8e822b131af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:31.594265 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-447980c7-1964-40bb-b4cd-b8e822b131af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:31.603440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-447980c7-1964-40bb-b4cd-b8e822b131af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1363 microversion: 2.1 time: 0.222784 Jan 11 14:21:31.604505 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 556/1132] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:31 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:31.966043 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-828ad208-2690-4856-8b81-224365815b41 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:31.967054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-828ad208-2690-4856-8b81-224365815b41 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:31.987998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-828ad208-2690-4856-8b81-224365815b41 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:31.988451 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-828ad208-2690-4856-8b81-224365815b41 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:31.989248 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-828ad208-2690-4856-8b81-224365815b41 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:31.989684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-828ad208-2690-4856-8b81-224365815b41 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:32.037818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-828ad208-2690-4856-8b81-224365815b41 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076011 Jan 11 14:21:32.043017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 577/1133] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:21:31 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:21:32.049629 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:32.050244 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:32.059746 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:32.060497 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:32.061301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:32.061738 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:32.119164 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-69925ef3-2572-4b2e-b7d4-4b787a611913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:32.120440 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-69925ef3-2572-4b2e-b7d4-4b787a611913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:32.130320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69925ef3-2572-4b2e-b7d4-4b787a611913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:32.130780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69925ef3-2572-4b2e-b7d4-4b787a611913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:32.131607 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69925ef3-2572-4b2e-b7d4-4b787a611913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:32.132055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-69925ef3-2572-4b2e-b7d4-4b787a611913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:32.149989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] HTTP exception thrown: Instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 is not attached to volume e932d8c1-a320-4cd4-aa49-babacc2dac6a Jan 11 14:21:32.150936 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Returning 404 to user: Instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 is not attached to volume e932d8c1-a320-4cd4-aa49-babacc2dac6a {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:21:32.152008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d001c577-423f-4b81-800e-eb4822781a10 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "DELETE /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments/e932d8c1-a320-4cd4-aa49-babacc2dac6a" status: 404 len: 154 microversion: 2.1 time: 0.107850 Jan 11 14:21:32.152909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 557/1134] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:21:32 2022] DELETE /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665/os-volume_attachments/e932d8c1-a320-4cd4-aa49-babacc2dac6a => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:21:32.220117 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-69925ef3-2572-4b2e-b7d4-4b787a611913 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.105458 Jan 11 14:21:32.220923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 578/1135] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:32 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:21:32.620684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5448f2a2-ff4f-4c8e-9878-189ef60406ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:32.621293 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5448f2a2-ff4f-4c8e-9878-189ef60406ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:32.627033 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5448f2a2-ff4f-4c8e-9878-189ef60406ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:32.627478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5448f2a2-ff4f-4c8e-9878-189ef60406ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:32.628838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5448f2a2-ff4f-4c8e-9878-189ef60406ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:32.629213 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5448f2a2-ff4f-4c8e-9878-189ef60406ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:32.753890 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-7ac9dfe8-a0b5-41e2-a99a-071a9bdfcfc8 req-c9966f9e-9c40-4fc5-9bf2-d45cc68d23e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0b9346-4e10-4ad4-95ae-5a822de41dad", "tag": "c4542d74-4b8d-4592-a074-26f4696dd8e0"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:32.755866 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:21:32.755866 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:21:32.756689 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5448f2a2-ff4f-4c8e-9878-189ef60406ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:32.764182 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-7ac9dfe8-a0b5-41e2-a99a-071a9bdfcfc8 req-c9966f9e-9c40-4fc5-9bf2-d45cc68d23e3 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:32.764634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-7ac9dfe8-a0b5-41e2-a99a-071a9bdfcfc8 req-c9966f9e-9c40-4fc5-9bf2-d45cc68d23e3 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:32.768487 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5448f2a2-ff4f-4c8e-9878-189ef60406ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1363 microversion: 2.1 time: 0.151530 Jan 11 14:21:32.769077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 558/1136] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:32 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:32.778562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-7ac9dfe8-a0b5-41e2-a99a-071a9bdfcfc8 req-c9966f9e-9c40-4fc5-9bf2-d45cc68d23e3 service nova] Creating event network-changed:c4542d74-4b8d-4592-a074-26f4696dd8e0 for instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad on hv-cinder-82413 Jan 11 14:21:32.783357 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-7ac9dfe8-a0b5-41e2-a99a-071a9bdfcfc8 req-c9966f9e-9c40-4fc5-9bf2-d45cc68d23e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034076 Jan 11 14:21:32.783976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 579/1137] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:21:33.232494 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d3292146-0d93-4709-862c-6ecce398bdab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:33.233405 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d3292146-0d93-4709-862c-6ecce398bdab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:33.240213 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3292146-0d93-4709-862c-6ecce398bdab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:33.240665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3292146-0d93-4709-862c-6ecce398bdab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:33.241455 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3292146-0d93-4709-862c-6ecce398bdab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:33.241898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d3292146-0d93-4709-862c-6ecce398bdab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:33.291287 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d5d9d4cc-f5a4-46b9-8e99-c5169ef42758 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:33.292038 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d5d9d4cc-f5a4-46b9-8e99-c5169ef42758 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:33.298832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d5d9d4cc-f5a4-46b9-8e99-c5169ef42758 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:33.299537 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d5d9d4cc-f5a4-46b9-8e99-c5169ef42758 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:33.301485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d5d9d4cc-f5a4-46b9-8e99-c5169ef42758 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:33.302101 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d5d9d4cc-f5a4-46b9-8e99-c5169ef42758 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:33.303170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d3292146-0d93-4709-862c-6ecce398bdab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.074315 Jan 11 14:21:33.303861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 559/1138] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:33 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:33.327182 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d5d9d4cc-f5a4-46b9-8e99-c5169ef42758 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:21:33.402891 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d5d9d4cc-f5a4-46b9-8e99-c5169ef42758 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "DELETE /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 204 len: 0 microversion: 2.1 time: 0.115778 Jan 11 14:21:33.403832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 580/1139] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:21:33 2022] DELETE /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 14:21:33.412871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a23bdf81-9504-41c7-81f7-e2c9109e9ed6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:33.413693 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a23bdf81-9504-41c7-81f7-e2c9109e9ed6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:33.420669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a23bdf81-9504-41c7-81f7-e2c9109e9ed6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:33.421207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a23bdf81-9504-41c7-81f7-e2c9109e9ed6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:33.422062 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a23bdf81-9504-41c7-81f7-e2c9109e9ed6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:33.422571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a23bdf81-9504-41c7-81f7-e2c9109e9ed6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:33.549825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a23bdf81-9504-41c7-81f7-e2c9109e9ed6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:33.557174 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a23bdf81-9504-41c7-81f7-e2c9109e9ed6 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1553 microversion: 2.1 time: 0.148930 Jan 11 14:21:33.557737 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 560/1140] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:33 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:21:33.788224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ec1a0de3-c153-4906-9d42-8ab4a0a40777 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:33.788924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ec1a0de3-c153-4906-9d42-8ab4a0a40777 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:33.795145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec1a0de3-c153-4906-9d42-8ab4a0a40777 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:33.795631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec1a0de3-c153-4906-9d42-8ab4a0a40777 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:33.796407 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec1a0de3-c153-4906-9d42-8ab4a0a40777 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:33.796839 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ec1a0de3-c153-4906-9d42-8ab4a0a40777 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:33.927449 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ec1a0de3-c153-4906-9d42-8ab4a0a40777 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:33.934698 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ec1a0de3-c153-4906-9d42-8ab4a0a40777 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1363 microversion: 2.1 time: 0.151169 Jan 11 14:21:33.935249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 581/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:33 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:34.314861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2a89dc37-df31-45cd-8c29-a5814a5bb10b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:34.316517 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2a89dc37-df31-45cd-8c29-a5814a5bb10b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:34.322826 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2a89dc37-df31-45cd-8c29-a5814a5bb10b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:34.323278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2a89dc37-df31-45cd-8c29-a5814a5bb10b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:34.324088 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2a89dc37-df31-45cd-8c29-a5814a5bb10b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:34.324529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2a89dc37-df31-45cd-8c29-a5814a5bb10b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:34.390098 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2a89dc37-df31-45cd-8c29-a5814a5bb10b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.078382 Jan 11 14:21:34.391114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 561/1142] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:34 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:21:34.574343 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cdd698d6-4879-4477-99fe-5c39996e27ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:34.575195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-cdd698d6-4879-4477-99fe-5c39996e27ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:34.581557 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cdd698d6-4879-4477-99fe-5c39996e27ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:34.582004 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cdd698d6-4879-4477-99fe-5c39996e27ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:34.582779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cdd698d6-4879-4477-99fe-5c39996e27ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:34.583207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-cdd698d6-4879-4477-99fe-5c39996e27ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:34.723689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-cdd698d6-4879-4477-99fe-5c39996e27ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:34.730870 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cdd698d6-4879-4477-99fe-5c39996e27ef tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1553 microversion: 2.1 time: 0.160401 Jan 11 14:21:34.731425 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 582/1143] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:34 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:34.952376 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9f8a9725-3ae0-425b-b26a-6b1916945b1a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:34.953078 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9f8a9725-3ae0-425b-b26a-6b1916945b1a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:34.961083 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9f8a9725-3ae0-425b-b26a-6b1916945b1a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:34.961531 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9f8a9725-3ae0-425b-b26a-6b1916945b1a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:34.962303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9f8a9725-3ae0-425b-b26a-6b1916945b1a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:34.962916 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9f8a9725-3ae0-425b-b26a-6b1916945b1a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:35.097851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9f8a9725-3ae0-425b-b26a-6b1916945b1a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:35.105241 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9f8a9725-3ae0-425b-b26a-6b1916945b1a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1363 microversion: 2.1 time: 0.157121 Jan 11 14:21:35.105801 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 562/1144] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:34 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:35.401365 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-83eb112f-9ce4-4bdb-95c3-8034f66b17a0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:35.402245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-83eb112f-9ce4-4bdb-95c3-8034f66b17a0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:35.408925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-83eb112f-9ce4-4bdb-95c3-8034f66b17a0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:35.409371 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-83eb112f-9ce4-4bdb-95c3-8034f66b17a0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:35.410145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-83eb112f-9ce4-4bdb-95c3-8034f66b17a0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:35.410580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-83eb112f-9ce4-4bdb-95c3-8034f66b17a0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:35.468708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-83eb112f-9ce4-4bdb-95c3-8034f66b17a0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.070909 Jan 11 14:21:35.472754 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 583/1145] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:35 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:35.748117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ac49c23b-d077-4c01-8941-af77deb6c746 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:35.749039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ac49c23b-d077-4c01-8941-af77deb6c746 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:35.756513 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac49c23b-d077-4c01-8941-af77deb6c746 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:35.756973 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac49c23b-d077-4c01-8941-af77deb6c746 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:35.757914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac49c23b-d077-4c01-8941-af77deb6c746 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:35.758361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ac49c23b-d077-4c01-8941-af77deb6c746 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:35.904836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-083e4d26-3915-464a-b999-84dfb066a1b2 req-0bc9eee8-99cb-4c36-a5e3-2aa688933106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "682faefe-6922-4f9f-b5b8-48b8c9a49665", "name": "network-vif-deleted", "tag": "c7e7af63-dba4-40f2-b97e-3dc8a5d14124"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:35.905422 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ac49c23b-d077-4c01-8941-af77deb6c746 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a441db140744442fa79e31985ade6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7f551824974a53a1ea507b061f4c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:35.906519 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:21:35.906519 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:21:35.913260 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ac49c23b-d077-4c01-8941-af77deb6c746 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 200 len: 1553 microversion: 2.1 time: 0.168842 Jan 11 14:21:35.913822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 563/1146] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:35 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:35.917318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-083e4d26-3915-464a-b999-84dfb066a1b2 req-0bc9eee8-99cb-4c36-a5e3-2aa688933106 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:35.918120 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-083e4d26-3915-464a-b999-84dfb066a1b2 req-0bc9eee8-99cb-4c36-a5e3-2aa688933106 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:35.930581 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-083e4d26-3915-464a-b999-84dfb066a1b2 req-0bc9eee8-99cb-4c36-a5e3-2aa688933106 service nova] Creating event network-vif-deleted:c7e7af63-dba4-40f2-b97e-3dc8a5d14124 for instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 on hv-cinder-82413 Jan 11 14:21:35.935272 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-083e4d26-3915-464a-b999-84dfb066a1b2 req-0bc9eee8-99cb-4c36-a5e3-2aa688933106 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035544 Jan 11 14:21:35.935884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 584/1147] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:21:36.122388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4122df85-5d0e-4377-9e88-8fd54aa90c98 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:36.122991 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4122df85-5d0e-4377-9e88-8fd54aa90c98 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:36.129367 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4122df85-5d0e-4377-9e88-8fd54aa90c98 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:36.129827 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4122df85-5d0e-4377-9e88-8fd54aa90c98 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:36.130615 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4122df85-5d0e-4377-9e88-8fd54aa90c98 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:36.131052 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4122df85-5d0e-4377-9e88-8fd54aa90c98 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:36.264564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4122df85-5d0e-4377-9e88-8fd54aa90c98 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:36.274172 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4122df85-5d0e-4377-9e88-8fd54aa90c98 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1363 microversion: 2.1 time: 0.155941 Jan 11 14:21:36.277561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 564/1148] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:36 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:36.481291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b3767ef5-9ea4-4825-ab0a-07a75f115dc1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:36.482229 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b3767ef5-9ea4-4825-ab0a-07a75f115dc1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:36.488688 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b3767ef5-9ea4-4825-ab0a-07a75f115dc1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:36.489122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b3767ef5-9ea4-4825-ab0a-07a75f115dc1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:36.489903 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b3767ef5-9ea4-4825-ab0a-07a75f115dc1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:36.490332 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b3767ef5-9ea4-4825-ab0a-07a75f115dc1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:36.553919 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b3767ef5-9ea4-4825-ab0a-07a75f115dc1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.076948 Jan 11 14:21:36.554532 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 585/1149] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:36 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:36.929919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:36.930563 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] [instance: 682faefe-6922-4f9f-b5b8-48b8c9a49665] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:36.936752 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:36.937202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:36.937978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:36.938412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:36.952028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] HTTP exception thrown: Instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 could not be found. Jan 11 14:21:36.952606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Returning 404 to user: Instance 682faefe-6922-4f9f-b5b8-48b8c9a49665 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:21:36.953442 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0d9c4b06-3fed-44ea-9f0f-f6a5737eac25 tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665" status: 404 len: 111 microversion: 2.1 time: 0.027310 Jan 11 14:21:36.953951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 565/1150] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:36 2022] GET /compute/v2.1/servers/682faefe-6922-4f9f-b5b8-48b8c9a49665 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:21:36.962858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3f7489ac-4f7e-4678-8eb6-6e6ceb076b2b tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] Calling method '.version_select at 0x7fba91c111f0>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:36.986633 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3f7489ac-4f7e-4678-8eb6-6e6ceb076b2b tempest-TestMinimumBasicScenario-892523759 tempest-TestMinimumBasicScenario-892523759-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-820440232" status: 202 len: 0 microversion: 2.1 time: 0.027820 Jan 11 14:21:36.987173 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 586/1151] 10.222.0.49 () {58 vars in 1268 bytes} [Tue Jan 11 14:21:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-820440232 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:37.289716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a73dffce-7f9e-4a8c-aff1-fbd1aa3a878f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:37.290403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a73dffce-7f9e-4a8c-aff1-fbd1aa3a878f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:37.296507 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a73dffce-7f9e-4a8c-aff1-fbd1aa3a878f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:37.296962 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a73dffce-7f9e-4a8c-aff1-fbd1aa3a878f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:37.297797 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a73dffce-7f9e-4a8c-aff1-fbd1aa3a878f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:37.298187 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a73dffce-7f9e-4a8c-aff1-fbd1aa3a878f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:37.443542 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a73dffce-7f9e-4a8c-aff1-fbd1aa3a878f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:37.451388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a73dffce-7f9e-4a8c-aff1-fbd1aa3a878f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1363 microversion: 2.1 time: 0.165246 Jan 11 14:21:37.451994 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 566/1152] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:37 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:37.567314 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5b2bd0c6-f7f1-44d2-9a6f-4a834e473ffb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:37.568352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5b2bd0c6-f7f1-44d2-9a6f-4a834e473ffb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:37.575228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5b2bd0c6-f7f1-44d2-9a6f-4a834e473ffb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:37.575732 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5b2bd0c6-f7f1-44d2-9a6f-4a834e473ffb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:37.576528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5b2bd0c6-f7f1-44d2-9a6f-4a834e473ffb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:37.576972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5b2bd0c6-f7f1-44d2-9a6f-4a834e473ffb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:37.640304 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5b2bd0c6-f7f1-44d2-9a6f-4a834e473ffb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.077990 Jan 11 14:21:37.641226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 587/1153] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:37 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:37.768571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-1b3dcb73-75bd-4eb1-a019-89c57722c9a8 req-c45e84dc-a77f-4f27-82a5-a853247916f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0b9346-4e10-4ad4-95ae-5a822de41dad", "name": "network-vif-plugged", "status": "completed", "tag": "c4542d74-4b8d-4592-a074-26f4696dd8e0"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:37.770291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:21:37.770291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:21:37.778163 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-1b3dcb73-75bd-4eb1-a019-89c57722c9a8 req-c45e84dc-a77f-4f27-82a5-a853247916f6 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:37.778699 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-1b3dcb73-75bd-4eb1-a019-89c57722c9a8 req-c45e84dc-a77f-4f27-82a5-a853247916f6 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:37.790516 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-1b3dcb73-75bd-4eb1-a019-89c57722c9a8 req-c45e84dc-a77f-4f27-82a5-a853247916f6 service nova] Creating event network-vif-plugged:c4542d74-4b8d-4592-a074-26f4696dd8e0 for instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad on hv-cinder-82413 Jan 11 14:21:37.795702 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-1b3dcb73-75bd-4eb1-a019-89c57722c9a8 req-c45e84dc-a77f-4f27-82a5-a853247916f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Jan 11 14:21:37.796397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 567/1154] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:21:38.469887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-133c7660-f81d-4101-9c0d-db90fcd79ab6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:38.470747 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-133c7660-f81d-4101-9c0d-db90fcd79ab6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:38.478388 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-133c7660-f81d-4101-9c0d-db90fcd79ab6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:38.478849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-133c7660-f81d-4101-9c0d-db90fcd79ab6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:38.479677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-133c7660-f81d-4101-9c0d-db90fcd79ab6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:38.480120 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-133c7660-f81d-4101-9c0d-db90fcd79ab6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:38.620730 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-133c7660-f81d-4101-9c0d-db90fcd79ab6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:38.628456 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-133c7660-f81d-4101-9c0d-db90fcd79ab6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1363 microversion: 2.1 time: 0.162707 Jan 11 14:21:38.629149 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 588/1155] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:38 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:38.652838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-486c7484-34fb-4811-913a-0ba5f5335e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:38.653871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-486c7484-34fb-4811-913a-0ba5f5335e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:38.661159 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-486c7484-34fb-4811-913a-0ba5f5335e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:38.661606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-486c7484-34fb-4811-913a-0ba5f5335e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:38.662398 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-486c7484-34fb-4811-913a-0ba5f5335e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:38.662834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-486c7484-34fb-4811-913a-0ba5f5335e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:38.727843 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-486c7484-34fb-4811-913a-0ba5f5335e35 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.078917 Jan 11 14:21:38.731748 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 568/1156] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:38 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:39.645465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d744f87f-77d3-483a-82bc-768465d386fd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:39.646674 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d744f87f-77d3-483a-82bc-768465d386fd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:39.653016 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d744f87f-77d3-483a-82bc-768465d386fd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:39.653467 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d744f87f-77d3-483a-82bc-768465d386fd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:39.654258 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d744f87f-77d3-483a-82bc-768465d386fd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:39.654699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d744f87f-77d3-483a-82bc-768465d386fd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:39.741191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3deda5ab-a7f4-4dac-bde8-46f78aff9ea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:39.742809 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3deda5ab-a7f4-4dac-bde8-46f78aff9ea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:39.751823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3deda5ab-a7f4-4dac-bde8-46f78aff9ea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:39.752437 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3deda5ab-a7f4-4dac-bde8-46f78aff9ea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:39.753547 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3deda5ab-a7f4-4dac-bde8-46f78aff9ea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:39.754780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3deda5ab-a7f4-4dac-bde8-46f78aff9ea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:39.808409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d744f87f-77d3-483a-82bc-768465d386fd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:39.817887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d744f87f-77d3-483a-82bc-768465d386fd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1549 microversion: 2.1 time: 0.176197 Jan 11 14:21:39.818800 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 589/1157] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:21:39 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:21:39.826255 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3deda5ab-a7f4-4dac-bde8-46f78aff9ea3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.089180 Jan 11 14:21:39.829264 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 569/1158] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:39 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:39.837632 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-680a3410-37f4-479b-b616-fc3135671905 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:39.838126 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-680a3410-37f4-479b-b616-fc3135671905 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:39.844282 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-680a3410-37f4-479b-b616-fc3135671905 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:39.844736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-680a3410-37f4-479b-b616-fc3135671905 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:39.845608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-680a3410-37f4-479b-b616-fc3135671905 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:39.846050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-680a3410-37f4-479b-b616-fc3135671905 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:39.935772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-680a3410-37f4-479b-b616-fc3135671905 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101737 Jan 11 14:21:39.936354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 590/1159] 10.222.0.49 () {58 vars in 1274 bytes} [Tue Jan 11 14:21:39 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:21:40.839464 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-40246980-12be-4929-a81b-dd8317e2b891 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:40.840642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-40246980-12be-4929-a81b-dd8317e2b891 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:40.852532 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-40246980-12be-4929-a81b-dd8317e2b891 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:40.855122 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-40246980-12be-4929-a81b-dd8317e2b891 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:40.856312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-40246980-12be-4929-a81b-dd8317e2b891 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:40.857792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-40246980-12be-4929-a81b-dd8317e2b891 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:40.931000 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d80f2003-a847-4a85-93d7-ec9c24044a0f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:40.932583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d80f2003-a847-4a85-93d7-ec9c24044a0f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:40.941611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-40246980-12be-4929-a81b-dd8317e2b891 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.105608 Jan 11 14:21:40.943420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d80f2003-a847-4a85-93d7-ec9c24044a0f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:40.944396 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d80f2003-a847-4a85-93d7-ec9c24044a0f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:40.946483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d80f2003-a847-4a85-93d7-ec9c24044a0f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:40.947432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d80f2003-a847-4a85-93d7-ec9c24044a0f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:40.948132 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 570/1160] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:40 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:40.962915 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-ec24d9fb-71a0-4fb3-9f0b-55166713102d req-745e1180-3701-49e3-aab2-0ca102b2634a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0b9346-4e10-4ad4-95ae-5a822de41dad", "tag": "c4542d74-4b8d-4592-a074-26f4696dd8e0"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:40.964473 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:21:40.964473 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:21:40.982666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-ec24d9fb-71a0-4fb3-9f0b-55166713102d req-745e1180-3701-49e3-aab2-0ca102b2634a service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:40.983471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-ec24d9fb-71a0-4fb3-9f0b-55166713102d req-745e1180-3701-49e3-aab2-0ca102b2634a service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:41.007111 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-ec24d9fb-71a0-4fb3-9f0b-55166713102d req-745e1180-3701-49e3-aab2-0ca102b2634a service nova] Creating event network-changed:c4542d74-4b8d-4592-a074-26f4696dd8e0 for instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad on hv-cinder-82413 Jan 11 14:21:41.007942 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d80f2003-a847-4a85-93d7-ec9c24044a0f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.080365 Jan 11 14:21:41.011421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 591/1161] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:40 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:41.018075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-ec24d9fb-71a0-4fb3-9f0b-55166713102d req-745e1180-3701-49e3-aab2-0ca102b2634a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068146 Jan 11 14:21:41.019161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 571/1162] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:21:41.958198 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-196ff678-98af-4154-b0ce-9f67ed784cbd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:41.959201 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-196ff678-98af-4154-b0ce-9f67ed784cbd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:41.966074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-196ff678-98af-4154-b0ce-9f67ed784cbd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:41.966517 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-196ff678-98af-4154-b0ce-9f67ed784cbd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:41.967296 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-196ff678-98af-4154-b0ce-9f67ed784cbd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:41.967773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-196ff678-98af-4154-b0ce-9f67ed784cbd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:42.019781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5075ad5a-7e95-4787-9128-e7c80e584514 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:42.027063 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5075ad5a-7e95-4787-9128-e7c80e584514 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:42.032009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-196ff678-98af-4154-b0ce-9f67ed784cbd tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.077862 Jan 11 14:21:42.033795 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 592/1163] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:41 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:21:42.034304 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5075ad5a-7e95-4787-9128-e7c80e584514 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:42.035517 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5075ad5a-7e95-4787-9128-e7c80e584514 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:42.036705 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5075ad5a-7e95-4787-9128-e7c80e584514 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:42.037342 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5075ad5a-7e95-4787-9128-e7c80e584514 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:42.096104 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5075ad5a-7e95-4787-9128-e7c80e584514 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.081206 Jan 11 14:21:42.096978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 572/1164] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:42 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:43.045108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5e4c6cab-9e47-4f7c-b5d4-b60264b1d6d7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:43.046102 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5e4c6cab-9e47-4f7c-b5d4-b60264b1d6d7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:43.052937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e4c6cab-9e47-4f7c-b5d4-b60264b1d6d7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:43.053392 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e4c6cab-9e47-4f7c-b5d4-b60264b1d6d7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:43.054178 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e4c6cab-9e47-4f7c-b5d4-b60264b1d6d7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:43.054612 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5e4c6cab-9e47-4f7c-b5d4-b60264b1d6d7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:43.108312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b9867426-d688-41e1-9e33-60e494db8a3e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:43.115708 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b9867426-d688-41e1-9e33-60e494db8a3e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:43.130180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5e4c6cab-9e47-4f7c-b5d4-b60264b1d6d7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.088967 Jan 11 14:21:43.131476 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b9867426-d688-41e1-9e33-60e494db8a3e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:43.132278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b9867426-d688-41e1-9e33-60e494db8a3e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:43.132937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 593/1165] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:43 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 14:21:43.133107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b9867426-d688-41e1-9e33-60e494db8a3e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:43.133587 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b9867426-d688-41e1-9e33-60e494db8a3e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:43.196989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b9867426-d688-41e1-9e33-60e494db8a3e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.093162 Jan 11 14:21:43.197935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 573/1166] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:43 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:44.143074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c258260f-012f-4b31-906c-60177699ad7f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:44.145050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c258260f-012f-4b31-906c-60177699ad7f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:44.161264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c258260f-012f-4b31-906c-60177699ad7f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:44.161264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c258260f-012f-4b31-906c-60177699ad7f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:44.162221 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c258260f-012f-4b31-906c-60177699ad7f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:44.162758 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c258260f-012f-4b31-906c-60177699ad7f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:44.209237 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-80861990-358c-4d31-9eb8-6b0d0acc7e86 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:44.210318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-80861990-358c-4d31-9eb8-6b0d0acc7e86 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:44.224169 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80861990-358c-4d31-9eb8-6b0d0acc7e86 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:44.224713 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80861990-358c-4d31-9eb8-6b0d0acc7e86 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:44.225585 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80861990-358c-4d31-9eb8-6b0d0acc7e86 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:44.226072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80861990-358c-4d31-9eb8-6b0d0acc7e86 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:44.230336 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c258260f-012f-4b31-906c-60177699ad7f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.091511 Jan 11 14:21:44.231062 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 594/1167] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:44 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:44.290226 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-80861990-358c-4d31-9eb8-6b0d0acc7e86 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.085210 Jan 11 14:21:44.293682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 574/1168] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:44 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:45.243335 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d2d7452f-b9cd-44d3-ae61-38d300f805f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:45.248569 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d2d7452f-b9cd-44d3-ae61-38d300f805f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:45.258200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2d7452f-b9cd-44d3-ae61-38d300f805f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:45.258592 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2d7452f-b9cd-44d3-ae61-38d300f805f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:45.259389 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2d7452f-b9cd-44d3-ae61-38d300f805f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:45.259859 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d2d7452f-b9cd-44d3-ae61-38d300f805f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:45.302866 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-89da0533-18b6-49f5-8f16-fbb9ff6cec19 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:45.303937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-89da0533-18b6-49f5-8f16-fbb9ff6cec19 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:45.311061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89da0533-18b6-49f5-8f16-fbb9ff6cec19 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:45.311576 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89da0533-18b6-49f5-8f16-fbb9ff6cec19 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:45.312739 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89da0533-18b6-49f5-8f16-fbb9ff6cec19 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:45.313458 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-89da0533-18b6-49f5-8f16-fbb9ff6cec19 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:45.323369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d2d7452f-b9cd-44d3-ae61-38d300f805f4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 28674 microversion: 2.20 time: 0.083781 Jan 11 14:21:45.324096 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 595/1169] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:45 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 28674 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:45.380613 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-89da0533-18b6-49f5-8f16-fbb9ff6cec19 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.082441 Jan 11 14:21:45.381252 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 575/1170] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:45 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:46.336487 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-92bb23ea-46f1-44ae-a132-19545d1288f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:46.337479 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-92bb23ea-46f1-44ae-a132-19545d1288f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:46.344227 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-92bb23ea-46f1-44ae-a132-19545d1288f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:46.344678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-92bb23ea-46f1-44ae-a132-19545d1288f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:46.345450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-92bb23ea-46f1-44ae-a132-19545d1288f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:46.345881 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-92bb23ea-46f1-44ae-a132-19545d1288f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:46.391902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-648c596a-a362-41a2-9858-54abeff447f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:46.392930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-648c596a-a362-41a2-9858-54abeff447f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:46.400374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-648c596a-a362-41a2-9858-54abeff447f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:46.400826 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-648c596a-a362-41a2-9858-54abeff447f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:46.401611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-648c596a-a362-41a2-9858-54abeff447f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:46.402046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-648c596a-a362-41a2-9858-54abeff447f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:46.426574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-92bb23ea-46f1-44ae-a132-19545d1288f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 30467 microversion: 2.20 time: 0.094590 Jan 11 14:21:46.427223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 596/1171] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:46 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 30467 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:46.466492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-648c596a-a362-41a2-9858-54abeff447f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.078541 Jan 11 14:21:46.467098 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 576/1172] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:46 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:47.438907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-63436d49-fd0d-45c5-805a-58978b300863 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:47.439921 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-63436d49-fd0d-45c5-805a-58978b300863 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:47.446697 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-63436d49-fd0d-45c5-805a-58978b300863 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:47.447140 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-63436d49-fd0d-45c5-805a-58978b300863 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:47.447936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-63436d49-fd0d-45c5-805a-58978b300863 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:47.448364 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-63436d49-fd0d-45c5-805a-58978b300863 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:47.479323 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-64461b50-ec5f-424a-a281-8da6c0fc4986 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:47.480343 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-64461b50-ec5f-424a-a281-8da6c0fc4986 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:47.487085 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64461b50-ec5f-424a-a281-8da6c0fc4986 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:47.487594 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64461b50-ec5f-424a-a281-8da6c0fc4986 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:47.489070 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64461b50-ec5f-424a-a281-8da6c0fc4986 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:47.489510 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-64461b50-ec5f-424a-a281-8da6c0fc4986 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:47.534127 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-63436d49-fd0d-45c5-805a-58978b300863 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 32147 microversion: 2.20 time: 0.099157 Jan 11 14:21:47.535261 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 597/1173] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:47 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 32147 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:47.563754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-64461b50-ec5f-424a-a281-8da6c0fc4986 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.088281 Jan 11 14:21:47.564484 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 577/1174] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:47 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:48.546793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-92a4f820-ef4e-4098-8000-7c90eacccba0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:48.547760 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-92a4f820-ef4e-4098-8000-7c90eacccba0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:48.555042 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-92a4f820-ef4e-4098-8000-7c90eacccba0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:48.555485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-92a4f820-ef4e-4098-8000-7c90eacccba0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:48.556278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-92a4f820-ef4e-4098-8000-7c90eacccba0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:48.556705 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-92a4f820-ef4e-4098-8000-7c90eacccba0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:48.574742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c6f689e2-0a3c-4938-bcbd-c7d182a7c653 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:48.576096 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c6f689e2-0a3c-4938-bcbd-c7d182a7c653 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:48.582938 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c6f689e2-0a3c-4938-bcbd-c7d182a7c653 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:48.583397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c6f689e2-0a3c-4938-bcbd-c7d182a7c653 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:48.584224 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c6f689e2-0a3c-4938-bcbd-c7d182a7c653 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:48.584665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c6f689e2-0a3c-4938-bcbd-c7d182a7c653 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:48.667092 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-92a4f820-ef4e-4098-8000-7c90eacccba0 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 33312 microversion: 2.20 time: 0.124306 Jan 11 14:21:48.667787 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 598/1175] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:48 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 33312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:48.681365 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c6f689e2-0a3c-4938-bcbd-c7d182a7c653 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.110552 Jan 11 14:21:48.682017 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 578/1176] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:48 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:49.678696 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-70ddf905-fad9-4c1e-a2f1-eaeb3a363431 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:49.679734 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-70ddf905-fad9-4c1e-a2f1-eaeb3a363431 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:49.686595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70ddf905-fad9-4c1e-a2f1-eaeb3a363431 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:49.687045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70ddf905-fad9-4c1e-a2f1-eaeb3a363431 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:49.687847 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70ddf905-fad9-4c1e-a2f1-eaeb3a363431 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:49.688278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-70ddf905-fad9-4c1e-a2f1-eaeb3a363431 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:49.693114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a78523a1-46ff-4ab9-b1e8-c298b01bd24d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:49.694147 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a78523a1-46ff-4ab9-b1e8-c298b01bd24d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:49.701341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a78523a1-46ff-4ab9-b1e8-c298b01bd24d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:49.701851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a78523a1-46ff-4ab9-b1e8-c298b01bd24d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:49.703051 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a78523a1-46ff-4ab9-b1e8-c298b01bd24d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:49.703051 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a78523a1-46ff-4ab9-b1e8-c298b01bd24d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:49.765083 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-70ddf905-fad9-4c1e-a2f1-eaeb3a363431 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 34382 microversion: 2.20 time: 0.090276 Jan 11 14:21:49.765991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 599/1177] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:49 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 34382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:49.777958 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a78523a1-46ff-4ab9-b1e8-c298b01bd24d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.089256 Jan 11 14:21:49.778570 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 579/1178] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:49 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 14:21:50.777919 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-470ea728-dbe9-4b90-a57f-022ba380e59b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:50.778909 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-470ea728-dbe9-4b90-a57f-022ba380e59b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:50.786424 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-470ea728-dbe9-4b90-a57f-022ba380e59b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:50.786905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-470ea728-dbe9-4b90-a57f-022ba380e59b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:50.787730 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-470ea728-dbe9-4b90-a57f-022ba380e59b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:50.788170 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-470ea728-dbe9-4b90-a57f-022ba380e59b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:50.789480 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4362aa90-638a-4d78-a2ce-f6db9959c9d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:50.790510 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4362aa90-638a-4d78-a2ce-f6db9959c9d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:50.797308 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4362aa90-638a-4d78-a2ce-f6db9959c9d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:50.797759 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4362aa90-638a-4d78-a2ce-f6db9959c9d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:50.798549 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4362aa90-638a-4d78-a2ce-f6db9959c9d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:50.798987 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4362aa90-638a-4d78-a2ce-f6db9959c9d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:50.866306 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-470ea728-dbe9-4b90-a57f-022ba380e59b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 35711 microversion: 2.20 time: 0.092301 Jan 11 14:21:50.867001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 600/1179] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:50 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 35711 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:50.878972 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4362aa90-638a-4d78-a2ce-f6db9959c9d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.093914 Jan 11 14:21:50.879606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 580/1180] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:50 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:51.878435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8fe9312a-57e0-4711-ab4c-e77dcf0c2f5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:51.879429 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8fe9312a-57e0-4711-ab4c-e77dcf0c2f5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:51.886324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8fe9312a-57e0-4711-ab4c-e77dcf0c2f5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:51.886775 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8fe9312a-57e0-4711-ab4c-e77dcf0c2f5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:51.887574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8fe9312a-57e0-4711-ab4c-e77dcf0c2f5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:51.888013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8fe9312a-57e0-4711-ab4c-e77dcf0c2f5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:51.889654 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-816fa1d1-2816-4df8-afde-2d7cb0322b3c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:51.890654 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-816fa1d1-2816-4df8-afde-2d7cb0322b3c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:51.897619 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-816fa1d1-2816-4df8-afde-2d7cb0322b3c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:51.898076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-816fa1d1-2816-4df8-afde-2d7cb0322b3c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:51.898861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-816fa1d1-2816-4df8-afde-2d7cb0322b3c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:51.899326 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-816fa1d1-2816-4df8-afde-2d7cb0322b3c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:51.971906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8fe9312a-57e0-4711-ab4c-e77dcf0c2f5b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 37184 microversion: 2.20 time: 0.097284 Jan 11 14:21:51.972987 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 601/1181] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:51 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 37184 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:51.984305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-816fa1d1-2816-4df8-afde-2d7cb0322b3c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 14 microversion: 2.1 time: 0.098463 Jan 11 14:21:51.984920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 581/1182] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:51 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:21:52.984703 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-97fe940a-4a59-4e95-8801-0a98aee6ca78 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:52.985628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-97fe940a-4a59-4e95-8801-0a98aee6ca78 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:52.993088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97fe940a-4a59-4e95-8801-0a98aee6ca78 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:52.993545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97fe940a-4a59-4e95-8801-0a98aee6ca78 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:52.994326 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97fe940a-4a59-4e95-8801-0a98aee6ca78 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:52.994757 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-97fe940a-4a59-4e95-8801-0a98aee6ca78 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:52.995181 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5560fec9-753e-4c60-a069-a72fdd0dd659 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:52.996250 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5560fec9-753e-4c60-a069-a72fdd0dd659 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:53.003012 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5560fec9-753e-4c60-a069-a72fdd0dd659 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:53.003466 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5560fec9-753e-4c60-a069-a72fdd0dd659 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:53.004881 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5560fec9-753e-4c60-a069-a72fdd0dd659 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:53.005319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5560fec9-753e-4c60-a069-a72fdd0dd659 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:53.067567 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-97fe940a-4a59-4e95-8801-0a98aee6ca78 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 38233 microversion: 2.20 time: 0.086200 Jan 11 14:21:53.068211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 602/1183] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:52 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 38233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:53.088083 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5560fec9-753e-4c60-a069-a72fdd0dd659 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 10009 microversion: 2.1 time: 0.096981 Jan 11 14:21:53.088694 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 582/1184] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:52 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 10009 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:21:54.080308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c86e4454-3751-41b9-a2ef-656e188d5655 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:54.081218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c86e4454-3751-41b9-a2ef-656e188d5655 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:54.088711 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c86e4454-3751-41b9-a2ef-656e188d5655 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:54.089164 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c86e4454-3751-41b9-a2ef-656e188d5655 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:54.089942 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c86e4454-3751-41b9-a2ef-656e188d5655 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:54.090379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c86e4454-3751-41b9-a2ef-656e188d5655 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:54.098453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-32cae3a4-1575-4fdb-805f-6ce734e49e55 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:54.099439 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-32cae3a4-1575-4fdb-805f-6ce734e49e55 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:54.106089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32cae3a4-1575-4fdb-805f-6ce734e49e55 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:54.106535 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32cae3a4-1575-4fdb-805f-6ce734e49e55 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:54.107307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32cae3a4-1575-4fdb-805f-6ce734e49e55 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:54.107763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32cae3a4-1575-4fdb-805f-6ce734e49e55 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:54.162424 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c86e4454-3751-41b9-a2ef-656e188d5655 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 38233 microversion: 2.20 time: 0.086190 Jan 11 14:21:54.163061 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 603/1185] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:54 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 38233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:54.185067 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-32cae3a4-1575-4fdb-805f-6ce734e49e55 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 17171 microversion: 2.1 time: 0.090492 Jan 11 14:21:54.185729 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 583/1186] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:54 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 17171 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:21:55.175048 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f4c2d014-86f6-4f58-8392-7010e2011f51 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:55.176691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f4c2d014-86f6-4f58-8392-7010e2011f51 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:55.183702 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f4c2d014-86f6-4f58-8392-7010e2011f51 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:55.184311 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f4c2d014-86f6-4f58-8392-7010e2011f51 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:55.185107 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f4c2d014-86f6-4f58-8392-7010e2011f51 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:55.185543 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f4c2d014-86f6-4f58-8392-7010e2011f51 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:55.196712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-eb63cdb3-ab37-45ca-b5b0-e28fca22881c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:55.197712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-eb63cdb3-ab37-45ca-b5b0-e28fca22881c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:55.204817 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb63cdb3-ab37-45ca-b5b0-e28fca22881c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:55.205275 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb63cdb3-ab37-45ca-b5b0-e28fca22881c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:55.206068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb63cdb3-ab37-45ca-b5b0-e28fca22881c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:55.206520 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb63cdb3-ab37-45ca-b5b0-e28fca22881c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:55.256623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f4c2d014-86f6-4f58-8392-7010e2011f51 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 38233 microversion: 2.20 time: 0.084967 Jan 11 14:21:55.257314 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 604/1187] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:55 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 38233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:55.288033 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-eb63cdb3-ab37-45ca-b5b0-e28fca22881c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 18356 microversion: 2.1 time: 0.095131 Jan 11 14:21:55.288750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 584/1188] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:55 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 18356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:21:56.269220 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b7788668-0e80-4eb1-bfce-31f5a6b91cc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:56.270219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b7788668-0e80-4eb1-bfce-31f5a6b91cc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:56.277014 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7788668-0e80-4eb1-bfce-31f5a6b91cc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:56.277474 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7788668-0e80-4eb1-bfce-31f5a6b91cc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:56.278254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7788668-0e80-4eb1-bfce-31f5a6b91cc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:56.278689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b7788668-0e80-4eb1-bfce-31f5a6b91cc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:56.299870 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-eff3905d-9132-4ea8-a84f-a8b5553441e6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:56.301367 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-eff3905d-9132-4ea8-a84f-a8b5553441e6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:56.308301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eff3905d-9132-4ea8-a84f-a8b5553441e6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:56.308764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eff3905d-9132-4ea8-a84f-a8b5553441e6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:56.309557 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eff3905d-9132-4ea8-a84f-a8b5553441e6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:56.309997 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eff3905d-9132-4ea8-a84f-a8b5553441e6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:56.349113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b7788668-0e80-4eb1-bfce-31f5a6b91cc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 38233 microversion: 2.20 time: 0.083863 Jan 11 14:21:56.349759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 605/1189] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:56 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 38233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:56.386219 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-eff3905d-9132-4ea8-a84f-a8b5553441e6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 20997 microversion: 2.1 time: 0.090368 Jan 11 14:21:56.386854 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 585/1190] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:56 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 20997 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:21:57.361560 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a7a8c29c-690a-4d53-a089-96537fba6fb5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:57.362626 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a7a8c29c-690a-4d53-a089-96537fba6fb5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:57.370108 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a7a8c29c-690a-4d53-a089-96537fba6fb5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:57.370561 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a7a8c29c-690a-4d53-a089-96537fba6fb5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:57.371342 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a7a8c29c-690a-4d53-a089-96537fba6fb5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:57.371804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a7a8c29c-690a-4d53-a089-96537fba6fb5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:57.397940 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3c203b37-3000-4f22-b332-53194015a187 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:57.398998 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3c203b37-3000-4f22-b332-53194015a187 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:57.405840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3c203b37-3000-4f22-b332-53194015a187 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:57.406291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3c203b37-3000-4f22-b332-53194015a187 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:57.407076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3c203b37-3000-4f22-b332-53194015a187 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:57.407529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3c203b37-3000-4f22-b332-53194015a187 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:57.442400 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a7a8c29c-690a-4d53-a089-96537fba6fb5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 200 len: 38376 microversion: 2.20 time: 0.084795 Jan 11 14:21:57.443060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 606/1191] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:57 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 38376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:21:57.453081 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bd9107a9-9f30-4af1-8198-faea8ee5baf6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:57.453657 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bd9107a9-9f30-4af1-8198-faea8ee5baf6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:57.461089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9107a9-9f30-4af1-8198-faea8ee5baf6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:57.461539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9107a9-9f30-4af1-8198-faea8ee5baf6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:57.462324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9107a9-9f30-4af1-8198-faea8ee5baf6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:57.462761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bd9107a9-9f30-4af1-8198-faea8ee5baf6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:57.486642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3c203b37-3000-4f22-b332-53194015a187 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 22854 microversion: 2.1 time: 0.092567 Jan 11 14:21:57.489168 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 586/1192] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:57 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 22854 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:21:57.489827 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bd9107a9-9f30-4af1-8198-faea8ee5baf6 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/ips" status: 200 len: 150 microversion: 2.20 time: 0.039768 Jan 11 14:21:57.490423 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 607/1193] 10.222.0.49 () {60 vars in 1288 bytes} [Tue Jan 11 14:21:57 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:21:58.499705 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-10ba3c14-d930-47f5-82fd-9c311f167ebb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:58.500686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-10ba3c14-d930-47f5-82fd-9c311f167ebb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:58.508095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-10ba3c14-d930-47f5-82fd-9c311f167ebb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:58.508549 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-10ba3c14-d930-47f5-82fd-9c311f167ebb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:58.509324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-10ba3c14-d930-47f5-82fd-9c311f167ebb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:58.509760 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-10ba3c14-d930-47f5-82fd-9c311f167ebb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:58.577276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-10ba3c14-d930-47f5-82fd-9c311f167ebb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 23804 microversion: 2.1 time: 0.081488 Jan 11 14:21:58.577818 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 587/1194] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:58 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 23804 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:21:59.520608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-20c89d9c-b5be-433e-9abb-d36a84db7038 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:59.521172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-20c89d9c-b5be-433e-9abb-d36a84db7038 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:59.527461 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20c89d9c-b5be-433e-9abb-d36a84db7038 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:59.527943 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20c89d9c-b5be-433e-9abb-d36a84db7038 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:59.528723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20c89d9c-b5be-433e-9abb-d36a84db7038 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:59.529164 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-20c89d9c-b5be-433e-9abb-d36a84db7038 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:59.550758 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-20c89d9c-b5be-433e-9abb-d36a84db7038 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lazy-loading 'flavor' on Instance uuid 3a120e67-9697-421a-a7ab-8d249487dc97 {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:21:59.589790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f1e93f27-3042-4e67-9abe-c6e7b454b870 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:21:59.591047 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f1e93f27-3042-4e67-9abe-c6e7b454b870 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:59.597639 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f1e93f27-3042-4e67-9abe-c6e7b454b870 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:59.597993 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f1e93f27-3042-4e67-9abe-c6e7b454b870 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:59.598913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f1e93f27-3042-4e67-9abe-c6e7b454b870 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:59.599391 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f1e93f27-3042-4e67-9abe-c6e7b454b870 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:59.673075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f1e93f27-3042-4e67-9abe-c6e7b454b870 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 25509 microversion: 2.1 time: 0.087196 Jan 11 14:21:59.673703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 588/1195] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:21:59 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 25509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:21:59.809399 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-20c89d9c-b5be-433e-9abb-d36a84db7038 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 202 len: 0 microversion: 2.20 time: 0.293029 Jan 11 14:21:59.810025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 608/1196] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:21:59 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:21:59.819125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:21:59.819849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:21:59.826975 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:59.827426 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:59.828239 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:21:59.828720 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:21:59.962133 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:59.970502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:59.972058 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:21:59.973249 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e1362a6d-fc6d-4b7e-b851-77be16173017 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.158873 Jan 11 14:21:59.973792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 589/1197] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:21:59 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:00.686297 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-51625032-b276-4a21-83c6-56c26371fb25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:00.687315 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-51625032-b276-4a21-83c6-56c26371fb25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:00.693535 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-51625032-b276-4a21-83c6-56c26371fb25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:00.693986 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-51625032-b276-4a21-83c6-56c26371fb25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:00.694767 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-51625032-b276-4a21-83c6-56c26371fb25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:00.695199 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-51625032-b276-4a21-83c6-56c26371fb25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:00.773946 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-51625032-b276-4a21-83c6-56c26371fb25 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 26824 microversion: 2.1 time: 0.091990 Jan 11 14:22:00.774720 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 609/1198] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:00 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 26824 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:00.991818 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:00.992359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:00.998657 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:00.999111 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:00.999925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:01.000368 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:01.133082 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:01.140762 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:01.142270 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:01.143410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b65e9fb7-267b-4caf-b3e2-1a364bb2c76e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.155428 Jan 11 14:22:01.143989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 590/1199] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:00 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:01.786116 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-93ee7697-3a33-4e74-928e-45119dad26fb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:01.787141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-93ee7697-3a33-4e74-928e-45119dad26fb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:01.793983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93ee7697-3a33-4e74-928e-45119dad26fb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:01.794438 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93ee7697-3a33-4e74-928e-45119dad26fb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:01.795214 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93ee7697-3a33-4e74-928e-45119dad26fb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:01.795678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-93ee7697-3a33-4e74-928e-45119dad26fb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:01.877346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-93ee7697-3a33-4e74-928e-45119dad26fb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 27528 microversion: 2.1 time: 0.095759 Jan 11 14:22:01.877963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 610/1200] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:01 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 27528 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:02.162642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:02.163261 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:02.169544 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:02.169992 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:02.170773 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:02.171213 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:02.297778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:02.305462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:02.307000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:02.308207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-eb2de756-2a36-47a6-8864-b03a177a7b2d tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.149905 Jan 11 14:22:02.308758 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 591/1201] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:02 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:02.889267 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-034574f5-bb98-4354-a99f-4531261b47ad tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:02.890273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-034574f5-bb98-4354-a99f-4531261b47ad tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:02.897165 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-034574f5-bb98-4354-a99f-4531261b47ad tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:02.897622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-034574f5-bb98-4354-a99f-4531261b47ad tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:02.898411 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-034574f5-bb98-4354-a99f-4531261b47ad tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:02.898853 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-034574f5-bb98-4354-a99f-4531261b47ad tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:02.988947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-034574f5-bb98-4354-a99f-4531261b47ad tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 27901 microversion: 2.1 time: 0.103079 Jan 11 14:22:02.989494 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 611/1202] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:02 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 27901 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:03.327424 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:03.328002 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:03.335277 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:03.335769 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:03.336550 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:03.336985 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:03.465597 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:03.473610 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:03.475123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:03.476303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8ce43d14-c9de-4484-820d-3548c2674f95 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.153476 Jan 11 14:22:03.476850 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 592/1203] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:03 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:04.000947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-53625d25-eab8-4cfe-b76d-96b72dc0af94 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:04.001863 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-53625d25-eab8-4cfe-b76d-96b72dc0af94 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:04.008745 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53625d25-eab8-4cfe-b76d-96b72dc0af94 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:04.009201 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53625d25-eab8-4cfe-b76d-96b72dc0af94 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:04.009978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53625d25-eab8-4cfe-b76d-96b72dc0af94 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:04.010413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53625d25-eab8-4cfe-b76d-96b72dc0af94 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:04.085524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-53625d25-eab8-4cfe-b76d-96b72dc0af94 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.088575 Jan 11 14:22:04.086142 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 612/1204] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:03 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:04.493809 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:04.494417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:04.500670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:04.501112 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:04.501887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:04.502318 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:04.632681 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:04.640541 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:04.642046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:04.643180 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-84eca973-f345-4178-a542-855c43669549 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.153062 Jan 11 14:22:04.643774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 593/1205] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:04 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:05.097456 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-96214adc-487f-4123-abbd-9cb3d25f35bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:05.098448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-96214adc-487f-4123-abbd-9cb3d25f35bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:05.105304 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-96214adc-487f-4123-abbd-9cb3d25f35bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:05.105754 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-96214adc-487f-4123-abbd-9cb3d25f35bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:05.106523 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-96214adc-487f-4123-abbd-9cb3d25f35bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:05.106956 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-96214adc-487f-4123-abbd-9cb3d25f35bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:05.172728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-96214adc-487f-4123-abbd-9cb3d25f35bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.079242 Jan 11 14:22:05.173417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 613/1206] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:05 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:05.662072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:05.662683 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:05.668896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:05.669347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:05.670124 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:05.670561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:05.716996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-902c7526-85c9-483e-b095-8dfb933dfa38 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:05.717662 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-902c7526-85c9-483e-b095-8dfb933dfa38 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:05.725262 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-902c7526-85c9-483e-b095-8dfb933dfa38 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:05.725792 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-902c7526-85c9-483e-b095-8dfb933dfa38 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:05.726654 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-902c7526-85c9-483e-b095-8dfb933dfa38 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:05.727151 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-902c7526-85c9-483e-b095-8dfb933dfa38 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:05.752113 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-902c7526-85c9-483e-b095-8dfb933dfa38 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:22:05.805212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:05.813083 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:05.814601 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:05.815790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c82ba252-5ee0-474b-b5a3-24a7530b4fd4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.157990 Jan 11 14:22:05.816351 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 594/1207] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:05 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:05.827080 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-902c7526-85c9-483e-b095-8dfb933dfa38 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "DELETE /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 204 len: 0 microversion: 2.1 time: 0.113795 Jan 11 14:22:05.827689 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 614/1208] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:22:05 2022] DELETE /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 14:22:05.835422 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ea19f80d-b0bc-49cc-bcd2-bb2c9dd7cd40 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:05.836079 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ea19f80d-b0bc-49cc-bcd2-bb2c9dd7cd40 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:05.841892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ea19f80d-b0bc-49cc-bcd2-bb2c9dd7cd40 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:05.842340 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ea19f80d-b0bc-49cc-bcd2-bb2c9dd7cd40 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:05.843120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ea19f80d-b0bc-49cc-bcd2-bb2c9dd7cd40 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:05.843588 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ea19f80d-b0bc-49cc-bcd2-bb2c9dd7cd40 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:05.970576 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ea19f80d-b0bc-49cc-bcd2-bb2c9dd7cd40 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:05.978385 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ea19f80d-b0bc-49cc-bcd2-bb2c9dd7cd40 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1579 microversion: 2.1 time: 0.146657 Jan 11 14:22:05.978948 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 595/1209] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:05 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1579 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:22:06.185169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6b9dfa7b-e989-45a4-9adb-c3756d904f46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:06.186082 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6b9dfa7b-e989-45a4-9adb-c3756d904f46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:06.192291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b9dfa7b-e989-45a4-9adb-c3756d904f46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:06.192736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b9dfa7b-e989-45a4-9adb-c3756d904f46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:06.193505 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b9dfa7b-e989-45a4-9adb-c3756d904f46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:06.193937 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b9dfa7b-e989-45a4-9adb-c3756d904f46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:06.255796 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6b9dfa7b-e989-45a4-9adb-c3756d904f46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.074483 Jan 11 14:22:06.256450 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 615/1210] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:06 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:06.834027 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:06.834666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:06.840900 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:06.841350 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:06.842126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:06.842565 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:06.970076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:06.977732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:06.979258 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:06.980437 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-42619720-92af-4763-b510-c146929bce2a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.150222 Jan 11 14:22:06.981013 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 596/1211] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:06 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:06.996484 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-31080b7e-9f65-4cf7-b175-01e344fa165b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:06.997436 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-31080b7e-9f65-4cf7-b175-01e344fa165b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:07.004264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-31080b7e-9f65-4cf7-b175-01e344fa165b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:07.005326 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-31080b7e-9f65-4cf7-b175-01e344fa165b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:07.006185 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-31080b7e-9f65-4cf7-b175-01e344fa165b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:07.006562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-31080b7e-9f65-4cf7-b175-01e344fa165b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:07.138982 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-31080b7e-9f65-4cf7-b175-01e344fa165b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:07.146242 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-31080b7e-9f65-4cf7-b175-01e344fa165b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1579 microversion: 2.1 time: 0.153905 Jan 11 14:22:07.146797 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 616/1212] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:06 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:07.266462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9ee6921f-2e16-492d-8513-583cc8e5ce7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:07.267334 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9ee6921f-2e16-492d-8513-583cc8e5ce7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:07.273295 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9ee6921f-2e16-492d-8513-583cc8e5ce7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:07.273748 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9ee6921f-2e16-492d-8513-583cc8e5ce7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:07.274533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9ee6921f-2e16-492d-8513-583cc8e5ce7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:07.274969 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9ee6921f-2e16-492d-8513-583cc8e5ce7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:07.345696 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9ee6921f-2e16-492d-8513-583cc8e5ce7d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.082751 Jan 11 14:22:07.346332 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 597/1213] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:07 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:07.998990 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:07.999610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:08.006550 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:08.006996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:08.007801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:08.008231 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:08.134893 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:08.143021 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:08.144631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:08.146431 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-850bc996-eb9f-4ed4-bbab-b04387b59d48 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.151202 Jan 11 14:22:08.146988 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 617/1214] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:07 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:08.162386 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c78c7c1b-0056-4f5d-aa7b-62bf52cdbc67 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:08.163164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c78c7c1b-0056-4f5d-aa7b-62bf52cdbc67 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:08.169978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c78c7c1b-0056-4f5d-aa7b-62bf52cdbc67 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:08.170495 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c78c7c1b-0056-4f5d-aa7b-62bf52cdbc67 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:08.171364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c78c7c1b-0056-4f5d-aa7b-62bf52cdbc67 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:08.171825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c78c7c1b-0056-4f5d-aa7b-62bf52cdbc67 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:08.312533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c78c7c1b-0056-4f5d-aa7b-62bf52cdbc67 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:08.321330 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c78c7c1b-0056-4f5d-aa7b-62bf52cdbc67 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 200 len: 1579 microversion: 2.1 time: 0.162726 Jan 11 14:22:08.321999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 598/1215] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:08 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:08.357675 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1df6d36b-8ff4-44b4-add5-57e6b80f23f8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:08.358640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1df6d36b-8ff4-44b4-add5-57e6b80f23f8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:08.365413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1df6d36b-8ff4-44b4-add5-57e6b80f23f8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:08.365867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1df6d36b-8ff4-44b4-add5-57e6b80f23f8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:08.366636 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1df6d36b-8ff4-44b4-add5-57e6b80f23f8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:08.367066 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1df6d36b-8ff4-44b4-add5-57e6b80f23f8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:08.431677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1df6d36b-8ff4-44b4-add5-57e6b80f23f8 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.077424 Jan 11 14:22:08.432554 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 618/1216] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:08 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:08.566417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-5e2a265f-0c2a-41cd-9215-8722ba62e0c2 req-31b6945a-b71d-4039-b487-8553cae1d394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201aaa53-5bdd-4883-a883-71b16db0ec92", "name": "network-vif-deleted", "tag": "5bad91d4-b4c4-4087-b072-80e2177b4913"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:08.568571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:22:08.568571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:22:08.576813 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-5e2a265f-0c2a-41cd-9215-8722ba62e0c2 req-31b6945a-b71d-4039-b487-8553cae1d394 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:08.577277 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-5e2a265f-0c2a-41cd-9215-8722ba62e0c2 req-31b6945a-b71d-4039-b487-8553cae1d394 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:08.598873 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-5e2a265f-0c2a-41cd-9215-8722ba62e0c2 req-31b6945a-b71d-4039-b487-8553cae1d394 service nova] Creating event network-vif-deleted:5bad91d4-b4c4-4087-b072-80e2177b4913 for instance 201aaa53-5bdd-4883-a883-71b16db0ec92 on hv-cinder-82413 Jan 11 14:22:08.603734 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-5e2a265f-0c2a-41cd-9215-8722ba62e0c2 req-31b6945a-b71d-4039-b487-8553cae1d394 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040903 Jan 11 14:22:08.604677 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 599/1217] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:22:09.164865 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:09.165571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:09.172839 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:09.173590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:09.174394 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:09.175044 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:09.321619 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:09.329948 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:09.331485 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:09.332684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d0835d3a-9bb4-4fab-b0f3-ea02bedb0673 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.172554 Jan 11 14:22:09.333750 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 619/1218] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:09 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:09.339197 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:09.340164 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:09.346941 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:09.347399 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:09.348231 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:09.349251 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:09.362254 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] HTTP exception thrown: Instance 201aaa53-5bdd-4883-a883-71b16db0ec92 could not be found. Jan 11 14:22:09.362851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Returning 404 to user: Instance 201aaa53-5bdd-4883-a883-71b16db0ec92 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:22:09.363703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ce725242-1156-433c-9b96-51698821423d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 404 len: 111 microversion: 2.1 time: 0.028448 Jan 11 14:22:09.364288 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 600/1219] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:09 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:22:09.443772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d3024d5c-f06f-41b0-8597-6e317d865c2e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:09.444681 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d3024d5c-f06f-41b0-8597-6e317d865c2e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:09.454369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d3024d5c-f06f-41b0-8597-6e317d865c2e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:09.454877 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d3024d5c-f06f-41b0-8597-6e317d865c2e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:09.455702 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d3024d5c-f06f-41b0-8597-6e317d865c2e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:09.456134 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d3024d5c-f06f-41b0-8597-6e317d865c2e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:09.462485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-347968926", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1740982666", "security_groups": [{"name": "tempest-secgroup-smoke-1576337113"}], "block_device_mapping_v2": [{"uuid": "597931e2-88b9-49ff-b7cf-c3b96e423fd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bafd8a92-c934-408c-97d9-8c6dc292a947"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:09.528514 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d3024d5c-f06f-41b0-8597-6e317d865c2e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.088823 Jan 11 14:22:09.529159 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 620/1220] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:09 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:22:09.570718 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] validate_networks() for [('bafd8a92-c934-408c-97d9-8c6dc292a947', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:22:10.149208 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:22:10.149665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:22:10.150136 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:22:10.150538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:22:10.150947 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:22:10.159320 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:10.159795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:10.160601 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:10.161535 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:10.177395 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for project 135a305e0bbe4cfcbfea666d19340195. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:22:10.181157 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for user 98f2499d9bdf4026b5f6b310d3e0b21c and project 135a305e0bbe4cfcbfea666d19340195. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:22:10.233240 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:22:10.235332 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='597931e2-88b9-49ff-b7cf-c3b96e423fd3',volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:22:10.351856 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:10.352430 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fcf06529-9a8d-4376-9133-ce4d66079b7e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.893981 Jan 11 14:22:10.352799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 601/1221] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:22:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 14:22:10.353650 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:10.361060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:10.361516 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:10.362015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b9e9bace-a50e-4348-8176-0782b06c6bc4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:10.362318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:10.362628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b9e9bace-a50e-4348-8176-0782b06c6bc4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:10.362739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:10.418676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b9e9bace-a50e-4348-8176-0782b06c6bc4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:10.425822 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b9e9bace-a50e-4348-8176-0782b06c6bc4 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1094 microversion: 2.1 time: 0.067310 Jan 11 14:22:10.427117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 602/1222] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:10 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:22:10.515401 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:10.524338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:10.525971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:10.527222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-de324094-c14c-4cdb-ae1f-186924207246 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.180125 Jan 11 14:22:10.528278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 621/1223] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:10 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:10.539568 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ed574de9-3be8-48f3-b4f1-0e7883c36074 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:10.540545 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ed574de9-3be8-48f3-b4f1-0e7883c36074 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:10.546374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ed574de9-3be8-48f3-b4f1-0e7883c36074 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:10.546825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ed574de9-3be8-48f3-b4f1-0e7883c36074 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:10.547680 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ed574de9-3be8-48f3-b4f1-0e7883c36074 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:10.548582 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ed574de9-3be8-48f3-b4f1-0e7883c36074 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:11.051243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ed574de9-3be8-48f3-b4f1-0e7883c36074 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.515449 Jan 11 14:22:11.052559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 603/1224] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:10 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:11.442976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7b8a8b63-2993-4dc9-a854-0cdf2ff48fac tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:11.443695 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7b8a8b63-2993-4dc9-a854-0cdf2ff48fac tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:11.450478 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b8a8b63-2993-4dc9-a854-0cdf2ff48fac tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:11.450925 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b8a8b63-2993-4dc9-a854-0cdf2ff48fac tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:11.451738 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b8a8b63-2993-4dc9-a854-0cdf2ff48fac tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:11.452202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7b8a8b63-2993-4dc9-a854-0cdf2ff48fac tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:11.512748 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7b8a8b63-2993-4dc9-a854-0cdf2ff48fac tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:11.520926 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7b8a8b63-2993-4dc9-a854-0cdf2ff48fac tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1210 microversion: 2.1 time: 0.080975 Jan 11 14:22:11.521610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 622/1225] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:11 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:11.546987 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:11.547720 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:11.555335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:11.555834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:11.556631 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:11.557121 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:11.713192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:11.721763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:11.724976 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:11.726531 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c2fc630e-f309-4101-8886-fff162a1d08b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1744 microversion: 2.20 time: 0.183280 Jan 11 14:22:11.727105 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 604/1226] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:11 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:12.065324 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5fa734a6-2d67-4f1d-9faa-57b65d064e29 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:12.066371 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5fa734a6-2d67-4f1d-9faa-57b65d064e29 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:12.077648 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5fa734a6-2d67-4f1d-9faa-57b65d064e29 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:12.078253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5fa734a6-2d67-4f1d-9faa-57b65d064e29 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:12.079106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5fa734a6-2d67-4f1d-9faa-57b65d064e29 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:12.079681 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5fa734a6-2d67-4f1d-9faa-57b65d064e29 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:12.145849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5fa734a6-2d67-4f1d-9faa-57b65d064e29 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.084622 Jan 11 14:22:12.146766 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 623/1227] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:12 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:12.537471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b38e526c-53d3-4a51-b475-6c633741034a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:12.538084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b38e526c-53d3-4a51-b475-6c633741034a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:12.544023 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b38e526c-53d3-4a51-b475-6c633741034a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:12.544475 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b38e526c-53d3-4a51-b475-6c633741034a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:12.545254 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b38e526c-53d3-4a51-b475-6c633741034a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:12.545722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b38e526c-53d3-4a51-b475-6c633741034a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:12.574787 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-f57699fe-a7d2-4893-a971-5cd2b34abe03 req-ab352aa1-116b-4e8a-9515-8186610d77d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f7f59c-094c-4dd0-bdd9-d0116cb8191e", "tag": "5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:12.576350 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:22:12.576350 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:22:12.587329 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-f57699fe-a7d2-4893-a971-5cd2b34abe03 req-ab352aa1-116b-4e8a-9515-8186610d77d9 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:12.587858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-f57699fe-a7d2-4893-a971-5cd2b34abe03 req-ab352aa1-116b-4e8a-9515-8186610d77d9 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:12.600433 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-f57699fe-a7d2-4893-a971-5cd2b34abe03 req-ab352aa1-116b-4e8a-9515-8186610d77d9 service nova] Creating event network-changed:5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4 for instance 10f7f59c-094c-4dd0-bdd9-d0116cb8191e on hv-cinder-82413 Jan 11 14:22:12.610981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-f57699fe-a7d2-4893-a971-5cd2b34abe03 req-ab352aa1-116b-4e8a-9515-8186610d77d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040365 Jan 11 14:22:12.611928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 624/1228] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:22:12.724179 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b38e526c-53d3-4a51-b475-6c633741034a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:12.732021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b38e526c-53d3-4a51-b475-6c633741034a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.198133 Jan 11 14:22:12.732602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 605/1229] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:12 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:12.748542 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:12.749734 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:12.756958 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:12.757577 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:12.758569 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:12.759138 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:12.893496 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:12.901622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:12.903145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:12.904342 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-09513e79-5c20-4b71-9866-2c332cffffb2 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1744 microversion: 2.20 time: 0.160943 Jan 11 14:22:12.904917 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 625/1230] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:12 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:13.158087 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d2aca398-17cc-4d5e-80b8-b99279361ae0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:13.159099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d2aca398-17cc-4d5e-80b8-b99279361ae0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:13.166070 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2aca398-17cc-4d5e-80b8-b99279361ae0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:13.166536 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2aca398-17cc-4d5e-80b8-b99279361ae0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:13.167329 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2aca398-17cc-4d5e-80b8-b99279361ae0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:13.167796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2aca398-17cc-4d5e-80b8-b99279361ae0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:13.546791 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d2aca398-17cc-4d5e-80b8-b99279361ae0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.392224 Jan 11 14:22:13.547481 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 606/1231] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:13 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:13.748608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-33ff9678-0012-4bae-9dda-8775902601b7 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:13.749313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-33ff9678-0012-4bae-9dda-8775902601b7 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:13.755640 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-33ff9678-0012-4bae-9dda-8775902601b7 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:13.756094 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-33ff9678-0012-4bae-9dda-8775902601b7 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:13.756873 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-33ff9678-0012-4bae-9dda-8775902601b7 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:13.757311 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-33ff9678-0012-4bae-9dda-8775902601b7 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:13.890916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-33ff9678-0012-4bae-9dda-8775902601b7 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:13.898699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-33ff9678-0012-4bae-9dda-8775902601b7 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.153807 Jan 11 14:22:13.899269 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 626/1232] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:13 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:13.923851 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:13.924662 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:13.931391 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:13.931878 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:13.932662 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:13.933101 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:13.964075 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-9b532d85-4c20-40a7-8bad-c6032f44cf6d req-13168530-652c-4f9c-a82e-2ba4fcea4025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a120e67-9697-421a-a7ab-8d249487dc97", "name": "network-vif-plugged", "status": "completed", "tag": "f98a27e9-7200-41e6-947a-d46ac07ecfd5"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:13.965599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:22:13.965599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:22:13.972916 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-9b532d85-4c20-40a7-8bad-c6032f44cf6d req-13168530-652c-4f9c-a82e-2ba4fcea4025 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:13.973421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-9b532d85-4c20-40a7-8bad-c6032f44cf6d req-13168530-652c-4f9c-a82e-2ba4fcea4025 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:13.985157 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-9b532d85-4c20-40a7-8bad-c6032f44cf6d req-13168530-652c-4f9c-a82e-2ba4fcea4025 service nova] Creating event network-vif-plugged:f98a27e9-7200-41e6-947a-d46ac07ecfd5 for instance 3a120e67-9697-421a-a7ab-8d249487dc97 on hv-cinder-82413 Jan 11 14:22:13.989915 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-9b532d85-4c20-40a7-8bad-c6032f44cf6d req-13168530-652c-4f9c-a82e-2ba4fcea4025 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029468 Jan 11 14:22:13.990677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 627/1233] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:22:14.066459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:14.074521 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:14.076354 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:14.077530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1b300896-98d4-4b09-9ef5-dae91b844043 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1744 microversion: 2.20 time: 0.158655 Jan 11 14:22:14.078084 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 607/1234] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:13 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:14.559415 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-df61e53f-f820-4914-a7a4-ad8b46cdd2cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:14.560425 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-df61e53f-f820-4914-a7a4-ad8b46cdd2cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:14.566486 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-df61e53f-f820-4914-a7a4-ad8b46cdd2cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:14.566936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-df61e53f-f820-4914-a7a4-ad8b46cdd2cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:14.568307 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-df61e53f-f820-4914-a7a4-ad8b46cdd2cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:14.568740 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-df61e53f-f820-4914-a7a4-ad8b46cdd2cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:14.915314 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-435b8009-eb28-45d5-9140-fb9ebed25684 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:14.915963 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-435b8009-eb28-45d5-9140-fb9ebed25684 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:14.922313 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-435b8009-eb28-45d5-9140-fb9ebed25684 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:14.922764 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-435b8009-eb28-45d5-9140-fb9ebed25684 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:14.923575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-435b8009-eb28-45d5-9140-fb9ebed25684 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:14.924021 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-435b8009-eb28-45d5-9140-fb9ebed25684 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:14.944495 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-df61e53f-f820-4914-a7a4-ad8b46cdd2cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.389389 Jan 11 14:22:14.945141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 628/1235] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:14 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:15.058398 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-435b8009-eb28-45d5-9140-fb9ebed25684 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:15.065836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-435b8009-eb28-45d5-9140-fb9ebed25684 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.154697 Jan 11 14:22:15.066408 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 608/1236] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:14 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:22:15.095424 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:15.096145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:15.103548 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:15.104006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:15.104780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:15.105216 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:15.231583 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:15.239709 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:15.241232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:15.242378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-178de9e8-f9c3-4a71-ab23-15d4ac7d2c4e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1744 microversion: 2.20 time: 0.150968 Jan 11 14:22:15.242929 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 629/1237] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:15 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:15.958001 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-07021d38-34a8-464e-84fb-bc763bbbf9ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:15.958841 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-07021d38-34a8-464e-84fb-bc763bbbf9ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:15.967633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-07021d38-34a8-464e-84fb-bc763bbbf9ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:15.968093 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-07021d38-34a8-464e-84fb-bc763bbbf9ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:15.968892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-07021d38-34a8-464e-84fb-bc763bbbf9ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:15.969361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-07021d38-34a8-464e-84fb-bc763bbbf9ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:16.033384 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-07021d38-34a8-464e-84fb-bc763bbbf9ac tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.079493 Jan 11 14:22:16.034046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 609/1238] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:15 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:16.081857 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ffe75f6f-d6ea-43fb-97ff-abb159183d2f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:16.082493 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ffe75f6f-d6ea-43fb-97ff-abb159183d2f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:16.088778 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffe75f6f-d6ea-43fb-97ff-abb159183d2f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:16.089226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffe75f6f-d6ea-43fb-97ff-abb159183d2f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:16.090000 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffe75f6f-d6ea-43fb-97ff-abb159183d2f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:16.090438 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ffe75f6f-d6ea-43fb-97ff-abb159183d2f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:16.217576 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ffe75f6f-d6ea-43fb-97ff-abb159183d2f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:16.225355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ffe75f6f-d6ea-43fb-97ff-abb159183d2f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.147265 Jan 11 14:22:16.225910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 630/1239] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:16 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:16.260940 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:16.261633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:16.268443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:16.268892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:16.269690 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:16.270118 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:16.405201 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:16.413504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:16.415039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:16.416248 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-77a1a868-29db-4d33-814c-809c6c31c929 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1744 microversion: 2.20 time: 0.159315 Jan 11 14:22:16.416805 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 610/1240] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:16 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:17.044622 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d802ea8c-278e-4ac6-9735-c9cde23a0857 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:17.045449 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d802ea8c-278e-4ac6-9735-c9cde23a0857 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:17.051742 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d802ea8c-278e-4ac6-9735-c9cde23a0857 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:17.052195 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d802ea8c-278e-4ac6-9735-c9cde23a0857 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:17.052972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d802ea8c-278e-4ac6-9735-c9cde23a0857 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:17.053409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d802ea8c-278e-4ac6-9735-c9cde23a0857 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:17.112849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d802ea8c-278e-4ac6-9735-c9cde23a0857 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.071965 Jan 11 14:22:17.113502 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 631/1241] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:17 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:17.241578 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-21a51516-7dea-4e42-aec9-a025c09a6e29 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:17.242191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-21a51516-7dea-4e42-aec9-a025c09a6e29 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:17.248462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-21a51516-7dea-4e42-aec9-a025c09a6e29 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:17.248913 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-21a51516-7dea-4e42-aec9-a025c09a6e29 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:17.249692 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-21a51516-7dea-4e42-aec9-a025c09a6e29 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:17.250131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-21a51516-7dea-4e42-aec9-a025c09a6e29 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:17.385257 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-21a51516-7dea-4e42-aec9-a025c09a6e29 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:17.392556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-21a51516-7dea-4e42-aec9-a025c09a6e29 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.154642 Jan 11 14:22:17.393114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 611/1242] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:17 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:17.434462 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:17.435179 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:17.441841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:17.442930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:17.443733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:17.444165 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:17.588219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:17.595971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:17.597524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:17.598677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0ebe3afa-33c3-4ec4-89a7-ac9aa717328c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.168371 Jan 11 14:22:17.599234 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 632/1243] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:17 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:18.124315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-70ba42b6-d1f9-4aca-abba-c9a475b4d7b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:18.125231 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-70ba42b6-d1f9-4aca-abba-c9a475b4d7b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:18.131847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-70ba42b6-d1f9-4aca-abba-c9a475b4d7b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:18.132313 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-70ba42b6-d1f9-4aca-abba-c9a475b4d7b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:18.133130 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-70ba42b6-d1f9-4aca-abba-c9a475b4d7b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:18.133561 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-70ba42b6-d1f9-4aca-abba-c9a475b4d7b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:18.202024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-70ba42b6-d1f9-4aca-abba-c9a475b4d7b4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.081238 Jan 11 14:22:18.206883 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 612/1244] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:18 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:18.410100 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-2621b73f-994a-43e0-bb33-2696bf4f3b60 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:18.413864 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-2621b73f-994a-43e0-bb33-2696bf4f3b60 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:18.421625 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2621b73f-994a-43e0-bb33-2696bf4f3b60 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:18.422353 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2621b73f-994a-43e0-bb33-2696bf4f3b60 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:18.423348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2621b73f-994a-43e0-bb33-2696bf4f3b60 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:18.423989 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-2621b73f-994a-43e0-bb33-2696bf4f3b60 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:18.567525 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-2621b73f-994a-43e0-bb33-2696bf4f3b60 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:18.575630 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-2621b73f-994a-43e0-bb33-2696bf4f3b60 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.169387 Jan 11 14:22:18.576206 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 633/1245] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:18 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:18.619446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:18.620882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:18.631772 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:18.632465 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:18.633454 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:18.634059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:18.792825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:18.802651 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:18.806763 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:18.807989 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b2b84747-5e49-40cd-9dd3-ea50b9dfe621 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.192773 Jan 11 14:22:18.809171 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 613/1246] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:18 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:19.214782 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e33fd71f-0a46-4291-8334-4ebad6d7b923 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:19.215869 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e33fd71f-0a46-4291-8334-4ebad6d7b923 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:19.222278 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e33fd71f-0a46-4291-8334-4ebad6d7b923 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:19.222818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e33fd71f-0a46-4291-8334-4ebad6d7b923 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:19.223907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e33fd71f-0a46-4291-8334-4ebad6d7b923 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:19.224373 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e33fd71f-0a46-4291-8334-4ebad6d7b923 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:19.289361 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e33fd71f-0a46-4291-8334-4ebad6d7b923 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28199 microversion: 2.1 time: 0.078240 Jan 11 14:22:19.293752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 634/1247] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:19 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:19.593106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1b6231e2-4391-49be-8041-e4758572cd6a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:19.594315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1b6231e2-4391-49be-8041-e4758572cd6a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:19.602689 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b6231e2-4391-49be-8041-e4758572cd6a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:19.603266 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b6231e2-4391-49be-8041-e4758572cd6a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:19.604182 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b6231e2-4391-49be-8041-e4758572cd6a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:19.604808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1b6231e2-4391-49be-8041-e4758572cd6a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:19.756859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1b6231e2-4391-49be-8041-e4758572cd6a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:19.764779 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1b6231e2-4391-49be-8041-e4758572cd6a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.175356 Jan 11 14:22:19.765355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 614/1248] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:19 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:19.826921 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:19.827536 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:19.834781 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:19.835162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:19.836054 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:19.836398 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:19.981629 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:19.991790 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:19.993530 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:19.995035 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f93ce499-5619-4b38-bde4-0c79b4d302ee tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.172479 Jan 11 14:22:19.999642 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 635/1249] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:19 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:20.302836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-94ddbc9c-6b18-456d-9641-561cd104ecc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:20.303905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-94ddbc9c-6b18-456d-9641-561cd104ecc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:20.310839 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-94ddbc9c-6b18-456d-9641-561cd104ecc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:20.311402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-94ddbc9c-6b18-456d-9641-561cd104ecc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:20.312413 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-94ddbc9c-6b18-456d-9641-561cd104ecc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:20.312855 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-94ddbc9c-6b18-456d-9641-561cd104ecc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:20.432795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-94ddbc9c-6b18-456d-9641-561cd104ecc3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28489 microversion: 2.1 time: 0.134957 Jan 11 14:22:20.433933 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 615/1250] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:20 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28489 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:20.781483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e6aab221-977b-4102-846c-59256a4459a2 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:20.782245 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e6aab221-977b-4102-846c-59256a4459a2 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:20.790165 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e6aab221-977b-4102-846c-59256a4459a2 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:20.790707 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e6aab221-977b-4102-846c-59256a4459a2 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:20.791639 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e6aab221-977b-4102-846c-59256a4459a2 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:20.792151 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e6aab221-977b-4102-846c-59256a4459a2 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:20.947202 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e6aab221-977b-4102-846c-59256a4459a2 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:20.954971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e6aab221-977b-4102-846c-59256a4459a2 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.177302 Jan 11 14:22:20.955465 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 636/1251] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:20 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:21.013392 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:21.014256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:21.021470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:21.021894 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:21.022942 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:21.023649 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:21.166346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:21.176821 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:21.179212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:21.180415 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-1796da69-163b-40e2-97c9-615659888d00 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.171148 Jan 11 14:22:21.181353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 616/1252] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:21 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:21.445628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6b5146d2-719a-4bf5-ae12-ca2a5c78c7e4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:21.446843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6b5146d2-719a-4bf5-ae12-ca2a5c78c7e4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:21.453755 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b5146d2-719a-4bf5-ae12-ca2a5c78c7e4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:21.454112 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b5146d2-719a-4bf5-ae12-ca2a5c78c7e4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:21.454947 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b5146d2-719a-4bf5-ae12-ca2a5c78c7e4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:21.455248 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6b5146d2-719a-4bf5-ae12-ca2a5c78c7e4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:21.518143 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6b5146d2-719a-4bf5-ae12-ca2a5c78c7e4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28489 microversion: 2.1 time: 0.076471 Jan 11 14:22:21.519158 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 637/1253] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:21 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28489 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:21.978899 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0329abdd-cedb-45ef-8e80-cab62a3a9d0f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:21.980205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0329abdd-cedb-45ef-8e80-cab62a3a9d0f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:21.989355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0329abdd-cedb-45ef-8e80-cab62a3a9d0f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:21.994549 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0329abdd-cedb-45ef-8e80-cab62a3a9d0f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:22.000411 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0329abdd-cedb-45ef-8e80-cab62a3a9d0f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:22.001174 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0329abdd-cedb-45ef-8e80-cab62a3a9d0f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:22.178528 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0329abdd-cedb-45ef-8e80-cab62a3a9d0f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:22.190873 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0329abdd-cedb-45ef-8e80-cab62a3a9d0f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.223201 Jan 11 14:22:22.191784 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 617/1254] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:21 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:22.198881 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:22.200684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:22.208094 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:22.208780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:22.209558 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:22.210268 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:22.359105 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:22.370814 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:22.372867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:22.374213 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-91d5f851-0c91-4d39-ae04-c700d9b95210 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.179382 Jan 11 14:22:22.375078 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 638/1255] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:22 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:22.530046 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8274b9f9-25e6-4917-8074-b2d9a06be9f7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:22.531020 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8274b9f9-25e6-4917-8074-b2d9a06be9f7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:22.538023 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8274b9f9-25e6-4917-8074-b2d9a06be9f7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:22.538557 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8274b9f9-25e6-4917-8074-b2d9a06be9f7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:22.539415 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8274b9f9-25e6-4917-8074-b2d9a06be9f7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:22.539957 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8274b9f9-25e6-4917-8074-b2d9a06be9f7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:22.616310 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8274b9f9-25e6-4917-8074-b2d9a06be9f7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.089627 Jan 11 14:22:22.620562 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 618/1256] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:22 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:23.208876 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f7180a64-555f-42ea-b8da-058b8f4dad8d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:23.210280 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f7180a64-555f-42ea-b8da-058b8f4dad8d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:23.217199 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f7180a64-555f-42ea-b8da-058b8f4dad8d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:23.217958 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f7180a64-555f-42ea-b8da-058b8f4dad8d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:23.219224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f7180a64-555f-42ea-b8da-058b8f4dad8d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:23.220274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f7180a64-555f-42ea-b8da-058b8f4dad8d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:23.362588 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f7180a64-555f-42ea-b8da-058b8f4dad8d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:23.371015 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f7180a64-555f-42ea-b8da-058b8f4dad8d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.166700 Jan 11 14:22:23.371827 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 639/1257] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:23 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:23.394324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:23.395478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:23.402310 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:23.402806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:23.403646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:23.404095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:23.564985 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:23.574612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:23.577537 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:23.578729 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3b472fc8-e382-485a-9c60-0d6ad0d12fec tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.188605 Jan 11 14:22:23.579762 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 619/1258] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:23 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:23.628272 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d93e310b-0f92-48fd-a6d2-7721827cabff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:23.636303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d93e310b-0f92-48fd-a6d2-7721827cabff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:23.646328 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d93e310b-0f92-48fd-a6d2-7721827cabff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:23.646841 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d93e310b-0f92-48fd-a6d2-7721827cabff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:23.647830 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d93e310b-0f92-48fd-a6d2-7721827cabff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:23.649107 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d93e310b-0f92-48fd-a6d2-7721827cabff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:23.720857 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d93e310b-0f92-48fd-a6d2-7721827cabff tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.096538 Jan 11 14:22:23.721517 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 640/1259] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:23 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:22:24.054437 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-574df731-66c4-4624-81ec-ddf4e1226904 req-58b9e375-aad2-48df-ae38-9effaf9ae892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f7f59c-094c-4dd0-bdd9-d0116cb8191e", "name": "network-vif-plugged", "status": "completed", "tag": "5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:24.056160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:22:24.056160 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:22:24.065030 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-574df731-66c4-4624-81ec-ddf4e1226904 req-58b9e375-aad2-48df-ae38-9effaf9ae892 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:24.065556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-574df731-66c4-4624-81ec-ddf4e1226904 req-58b9e375-aad2-48df-ae38-9effaf9ae892 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:24.079980 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-574df731-66c4-4624-81ec-ddf4e1226904 req-58b9e375-aad2-48df-ae38-9effaf9ae892 service nova] Creating event network-vif-plugged:5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4 for instance 10f7f59c-094c-4dd0-bdd9-d0116cb8191e on hv-cinder-82413 Jan 11 14:22:24.085469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-574df731-66c4-4624-81ec-ddf4e1226904 req-58b9e375-aad2-48df-ae38-9effaf9ae892 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035570 Jan 11 14:22:24.086268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 620/1260] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:22:24.392569 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-83193e31-0c4b-4bf4-9e15-aa1e24192e55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:24.394009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-83193e31-0c4b-4bf4-9e15-aa1e24192e55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:24.405183 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-83193e31-0c4b-4bf4-9e15-aa1e24192e55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:24.406631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-83193e31-0c4b-4bf4-9e15-aa1e24192e55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:24.408391 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-83193e31-0c4b-4bf4-9e15-aa1e24192e55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:24.409437 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-83193e31-0c4b-4bf4-9e15-aa1e24192e55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:24.565294 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-83193e31-0c4b-4bf4-9e15-aa1e24192e55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:24.575737 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-83193e31-0c4b-4bf4-9e15-aa1e24192e55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.190626 Jan 11 14:22:24.576511 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 641/1261] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:24 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:24.599852 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:24.600641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:24.607917 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:24.608511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:24.609468 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:24.610090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:24.741638 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a30efa3e-8666-4391-8b08-3ba09ad90499 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:24.743242 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a30efa3e-8666-4391-8b08-3ba09ad90499 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:24.751466 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a30efa3e-8666-4391-8b08-3ba09ad90499 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:24.752056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a30efa3e-8666-4391-8b08-3ba09ad90499 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:24.752934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a30efa3e-8666-4391-8b08-3ba09ad90499 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:24.753446 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a30efa3e-8666-4391-8b08-3ba09ad90499 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:24.764020 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:24.773422 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:24.774968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:24.776197 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dcb045a5-a283-4e12-8b23-4f8655eacba9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.182570 Jan 11 14:22:24.776767 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 621/1262] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:24 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:24.837509 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a30efa3e-8666-4391-8b08-3ba09ad90499 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.107362 Jan 11 14:22:24.838779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 642/1263] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:24 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:25.593910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-46e69c14-8727-4591-aa05-3842f2b358af tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:25.594691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-46e69c14-8727-4591-aa05-3842f2b358af tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:25.602077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-46e69c14-8727-4591-aa05-3842f2b358af tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:25.602690 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-46e69c14-8727-4591-aa05-3842f2b358af tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:25.603309 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-46e69c14-8727-4591-aa05-3842f2b358af tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:25.603781 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-46e69c14-8727-4591-aa05-3842f2b358af tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:25.740399 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-46e69c14-8727-4591-aa05-3842f2b358af tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:25.748784 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-46e69c14-8727-4591-aa05-3842f2b358af tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1266 microversion: 2.1 time: 0.158491 Jan 11 14:22:25.755885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 622/1264] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:25 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:25.800870 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:25.801617 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:25.809343 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:25.809343 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:25.810444 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:25.810895 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:25.852228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f42da455-8c30-455d-8c02-caf01d9021b6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:25.853053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f42da455-8c30-455d-8c02-caf01d9021b6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:25.866552 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f42da455-8c30-455d-8c02-caf01d9021b6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:25.867292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f42da455-8c30-455d-8c02-caf01d9021b6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:25.868297 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f42da455-8c30-455d-8c02-caf01d9021b6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:25.868904 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f42da455-8c30-455d-8c02-caf01d9021b6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:25.956642 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f42da455-8c30-455d-8c02-caf01d9021b6 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.108836 Jan 11 14:22:25.961418 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 623/1265] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:25 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:26.000576 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:26.024977 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:26.026595 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:26.027883 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-637c74bc-234d-40b1-bcee-a7b4a02b5b17 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.231223 Jan 11 14:22:26.034271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 643/1266] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:25 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:26.769560 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-41e10897-cb30-4edf-bff6-7200a5a6ce89 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:26.770837 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-41e10897-cb30-4edf-bff6-7200a5a6ce89 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:26.784815 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-41e10897-cb30-4edf-bff6-7200a5a6ce89 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:26.785269 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-41e10897-cb30-4edf-bff6-7200a5a6ce89 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:26.786102 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-41e10897-cb30-4edf-bff6-7200a5a6ce89 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:26.786538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-41e10897-cb30-4edf-bff6-7200a5a6ce89 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:26.939213 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-41e10897-cb30-4edf-bff6-7200a5a6ce89 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:26.947646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-41e10897-cb30-4edf-bff6-7200a5a6ce89 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1453 microversion: 2.1 time: 0.185342 Jan 11 14:22:26.948238 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 624/1267] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:26 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:26.964786 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ada7729c-20e7-4cbc-a34b-5610c7afbf86 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:26.965335 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ada7729c-20e7-4cbc-a34b-5610c7afbf86 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:26.969446 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-53d12c48-d717-4fff-a483-c2199282fdcb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:26.970386 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-53d12c48-d717-4fff-a483-c2199282fdcb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:26.972029 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ada7729c-20e7-4cbc-a34b-5610c7afbf86 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:26.975544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ada7729c-20e7-4cbc-a34b-5610c7afbf86 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:26.975544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ada7729c-20e7-4cbc-a34b-5610c7afbf86 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:26.975544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ada7729c-20e7-4cbc-a34b-5610c7afbf86 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:26.977102 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53d12c48-d717-4fff-a483-c2199282fdcb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:26.978965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53d12c48-d717-4fff-a483-c2199282fdcb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:26.978965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53d12c48-d717-4fff-a483-c2199282fdcb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:26.978965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-53d12c48-d717-4fff-a483-c2199282fdcb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:27.050469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-53d12c48-d717-4fff-a483-c2199282fdcb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.085639 Jan 11 14:22:27.051896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 625/1268] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:26 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:22:27.057317 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:27.058026 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:27.065076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:27.065545 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:27.066346 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:27.067347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:27.155687 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ada7729c-20e7-4cbc-a34b-5610c7afbf86 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:27.163452 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ada7729c-20e7-4cbc-a34b-5610c7afbf86 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1453 microversion: 2.1 time: 0.202677 Jan 11 14:22:27.164172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 644/1269] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:22:26 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:22:27.246237 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:27.256278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:27.257835 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:27.259075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d2c1fb1c-f914-48e2-8626-836fa5665ee7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.206076 Jan 11 14:22:27.259712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 626/1270] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:27 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:28.062617 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-123b7504-854b-44e1-9e41-c14cc91661f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:28.063875 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-123b7504-854b-44e1-9e41-c14cc91661f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:28.070633 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-123b7504-854b-44e1-9e41-c14cc91661f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:28.071079 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-123b7504-854b-44e1-9e41-c14cc91661f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:28.071897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-123b7504-854b-44e1-9e41-c14cc91661f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:28.072333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-123b7504-854b-44e1-9e41-c14cc91661f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:28.198341 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-123b7504-854b-44e1-9e41-c14cc91661f3 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.139644 Jan 11 14:22:28.202536 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 645/1271] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:28 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:28.278044 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:28.278687 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:28.285203 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:28.285750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:28.286549 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:28.286991 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:28.420305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:28.428311 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:28.429837 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:28.431040 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e2c8dcdb-9025-4a0c-935e-e32639079f18 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1739 microversion: 2.20 time: 0.156796 Jan 11 14:22:28.431641 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 627/1272] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:28 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:28.844313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-d45d3bc1-f3cb-475d-9d3d-c4e54ae81a97 req-1cb3a6b0-a055-49c4-bdfa-08ef41725cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f7f59c-094c-4dd0-bdd9-d0116cb8191e", "tag": "5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:28.845786 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:22:28.845786 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:22:28.854406 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-d45d3bc1-f3cb-475d-9d3d-c4e54ae81a97 req-1cb3a6b0-a055-49c4-bdfa-08ef41725cc5 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:28.854901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-d45d3bc1-f3cb-475d-9d3d-c4e54ae81a97 req-1cb3a6b0-a055-49c4-bdfa-08ef41725cc5 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:28.867603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-d45d3bc1-f3cb-475d-9d3d-c4e54ae81a97 req-1cb3a6b0-a055-49c4-bdfa-08ef41725cc5 service nova] Creating event network-changed:5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4 for instance 10f7f59c-094c-4dd0-bdd9-d0116cb8191e on hv-cinder-82413 Jan 11 14:22:28.872896 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-d45d3bc1-f3cb-475d-9d3d-c4e54ae81a97 req-1cb3a6b0-a055-49c4-bdfa-08ef41725cc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032501 Jan 11 14:22:28.873661 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 646/1273] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:22:29.211188 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-c3e3fcdf-3d7c-43b7-abb9-ca722fed83b7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:29.212092 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-c3e3fcdf-3d7c-43b7-abb9-ca722fed83b7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:29.221132 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c3e3fcdf-3d7c-43b7-abb9-ca722fed83b7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:29.222051 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c3e3fcdf-3d7c-43b7-abb9-ca722fed83b7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:29.225315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c3e3fcdf-3d7c-43b7-abb9-ca722fed83b7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:29.225978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-c3e3fcdf-3d7c-43b7-abb9-ca722fed83b7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:29.310431 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-c3e3fcdf-3d7c-43b7-abb9-ca722fed83b7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.099540 Jan 11 14:22:29.310431 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 628/1274] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:29 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:29.452413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:29.453290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:29.461286 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:29.462273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:29.463225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:29.463930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:29.602546 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:29.612306 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:29.614887 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:29.616698 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0ac8b31a-405b-4b6b-a7b8-d9dfed529aa8 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1721 microversion: 2.20 time: 0.169882 Jan 11 14:22:29.617267 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 647/1275] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:29 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:30.319332 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5c73c503-fe0e-4c4f-aefa-d4647bbf0c96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:30.320278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5c73c503-fe0e-4c4f-aefa-d4647bbf0c96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:30.327511 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5c73c503-fe0e-4c4f-aefa-d4647bbf0c96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:30.327967 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5c73c503-fe0e-4c4f-aefa-d4647bbf0c96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:30.328749 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5c73c503-fe0e-4c4f-aefa-d4647bbf0c96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:30.329187 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5c73c503-fe0e-4c4f-aefa-d4647bbf0c96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:30.400007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5c73c503-fe0e-4c4f-aefa-d4647bbf0c96 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.085236 Jan 11 14:22:30.400631 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 629/1276] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:30 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:30.634250 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:30.634780 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:30.641077 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:30.641528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:30.642299 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:30.642729 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:30.771006 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:30.778915 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:30.780594 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:30.782273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bde04d32-3ebf-4d06-8ebb-876412e825f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1721 microversion: 2.20 time: 0.151328 Jan 11 14:22:30.782398 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 648/1277] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:30 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:31.412022 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-85f3f8a2-d52a-453d-baaa-7dd386ef3194 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:31.413023 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-85f3f8a2-d52a-453d-baaa-7dd386ef3194 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:31.419855 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-85f3f8a2-d52a-453d-baaa-7dd386ef3194 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:31.420309 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-85f3f8a2-d52a-453d-baaa-7dd386ef3194 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:31.421098 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-85f3f8a2-d52a-453d-baaa-7dd386ef3194 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:31.421540 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-85f3f8a2-d52a-453d-baaa-7dd386ef3194 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:31.492262 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-85f3f8a2-d52a-453d-baaa-7dd386ef3194 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.084158 Jan 11 14:22:31.492994 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 630/1278] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:31 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:31.800320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:31.801483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:31.807897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:31.808333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:31.809107 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:31.809538 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:31.938076 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:31.945932 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:31.947453 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:31.948628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f8c316fa-2004-4eb5-8372-c516b3870b60 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1664 microversion: 2.20 time: 0.152108 Jan 11 14:22:31.949185 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 649/1279] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:31 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:31.966816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-167a48e2-3b6b-4b5b-9ef3-7cc2c3eb22bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6787a98-677a-4464-90cd-bff27ab6f3df"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:31.967910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-167a48e2-3b6b-4b5b-9ef3-7cc2c3eb22bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:31.975244 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-167a48e2-3b6b-4b5b-9ef3-7cc2c3eb22bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:31.975749 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-167a48e2-3b6b-4b5b-9ef3-7cc2c3eb22bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:31.976533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-167a48e2-3b6b-4b5b-9ef3-7cc2c3eb22bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:31.976971 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-167a48e2-3b6b-4b5b-9ef3-7cc2c3eb22bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.004516 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-189ddcce-b9b6-445c-b798-537f9cf02745 req-cf8da54b-67a9-4470-ac8f-9bdc9221d7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a120e67-9697-421a-a7ab-8d249487dc97", "name": "network-vif-unplugged", "status": "completed", "tag": "f98a27e9-7200-41e6-947a-d46ac07ecfd5"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:32.006295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:22:32.006295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:22:32.013250 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-189ddcce-b9b6-445c-b798-537f9cf02745 req-cf8da54b-67a9-4470-ac8f-9bdc9221d7a6 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.013678 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-189ddcce-b9b6-445c-b798-537f9cf02745 req-cf8da54b-67a9-4470-ac8f-9bdc9221d7a6 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.024828 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.compute.server_external_events [req-189ddcce-b9b6-445c-b798-537f9cf02745 req-cf8da54b-67a9-4470-ac8f-9bdc9221d7a6 service nova] Unable to find a host for instance 3a120e67-9697-421a-a7ab-8d249487dc97. Dropping event network-vif-unplugged {{(pid=116474) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 11 14:22:32.025734 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-189ddcce-b9b6-445c-b798-537f9cf02745 req-cf8da54b-67a9-4470-ac8f-9bdc9221d7a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025388 Jan 11 14:22:32.026505 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 650/1280] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 11 14:22:32.227120 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-167a48e2-3b6b-4b5b-9ef3-7cc2c3eb22bf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.264429 Jan 11 14:22:32.227703 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 631/1281] 10.222.0.49 () {62 vars in 1363 bytes} [Tue Jan 11 14:22:31 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/os-volume_attachments => generated 188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:32.334535 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-673d349d-5e63-4d26-b7ac-eda69047ac4f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:32.335025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-673d349d-5e63-4d26-b7ac-eda69047ac4f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:32.341425 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-673d349d-5e63-4d26-b7ac-eda69047ac4f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.341875 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-673d349d-5e63-4d26-b7ac-eda69047ac4f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.342648 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-673d349d-5e63-4d26-b7ac-eda69047ac4f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.343085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-673d349d-5e63-4d26-b7ac-eda69047ac4f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.504022 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b2b9ffe1-096d-44b7-95d7-3edd6b0df36c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:32.504882 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b2b9ffe1-096d-44b7-95d7-3edd6b0df36c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:32.511092 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2b9ffe1-096d-44b7-95d7-3edd6b0df36c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.511575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2b9ffe1-096d-44b7-95d7-3edd6b0df36c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.512356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2b9ffe1-096d-44b7-95d7-3edd6b0df36c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.512797 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b2b9ffe1-096d-44b7-95d7-3edd6b0df36c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.564902 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-673d349d-5e63-4d26-b7ac-eda69047ac4f tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/os-volume_attachments/e6787a98-677a-4464-90cd-bff27ab6f3df" status: 202 len: 0 microversion: 2.20 time: 0.234678 Jan 11 14:22:32.565488 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 651/1282] 10.222.0.49 () {60 vars in 1456 bytes} [Tue Jan 11 14:22:32 2022] DELETE /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/os-volume_attachments/e6787a98-677a-4464-90cd-bff27ab6f3df => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:22:32.579717 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b2b9ffe1-096d-44b7-95d7-3edd6b0df36c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.079423 Jan 11 14:22:32.580372 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 632/1283] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:32 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 14:22:32.618106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f6cf9a0f-014a-4e9f-91c0-2505335e2146 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:32.618675 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f6cf9a0f-014a-4e9f-91c0-2505335e2146 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:32.625030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f6cf9a0f-014a-4e9f-91c0-2505335e2146 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.625481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f6cf9a0f-014a-4e9f-91c0-2505335e2146 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.626253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f6cf9a0f-014a-4e9f-91c0-2505335e2146 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.626684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f6cf9a0f-014a-4e9f-91c0-2505335e2146 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.703779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f6cf9a0f-014a-4e9f-91c0-2505335e2146 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action" status: 202 len: 0 microversion: 2.20 time: 0.089003 Jan 11 14:22:32.704085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 652/1284] 10.222.0.49 () {62 vars in 1318 bytes} [Tue Jan 11 14:22:32 2022] POST /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:22:32.713074 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:32.713807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:32.720604 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.721056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.721841 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:32.722276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:32.858139 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:32.866087 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:32.867656 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:32.868807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-962d50c1-8e3d-4071-981f-a9e483031a31 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1672 microversion: 2.20 time: 0.159854 Jan 11 14:22:32.869361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 633/1285] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:32 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:33.592167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-930ae872-430c-4351-8d11-9d44bffebf3b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:33.593129 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-930ae872-430c-4351-8d11-9d44bffebf3b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:33.599396 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-930ae872-430c-4351-8d11-9d44bffebf3b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:33.599876 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-930ae872-430c-4351-8d11-9d44bffebf3b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:33.600658 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-930ae872-430c-4351-8d11-9d44bffebf3b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:33.601096 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-930ae872-430c-4351-8d11-9d44bffebf3b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:33.664867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-930ae872-430c-4351-8d11-9d44bffebf3b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.076602 Jan 11 14:22:33.665796 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 653/1286] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:33 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:33.887606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:33.888210 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:33.894537 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:33.895528 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:33.896303 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:33.896731 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:34.030476 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:34.039290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:34.040849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:34.042005 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-de55e229-8e33-4e85-b77f-1e74c735a351 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.158229 Jan 11 14:22:34.042560 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 634/1287] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:33 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:34.676320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3dfa6667-60bf-478e-a880-887e596dd53e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:34.677354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3dfa6667-60bf-478e-a880-887e596dd53e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:34.684141 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3dfa6667-60bf-478e-a880-887e596dd53e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:34.684594 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3dfa6667-60bf-478e-a880-887e596dd53e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:34.685386 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3dfa6667-60bf-478e-a880-887e596dd53e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:34.685825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3dfa6667-60bf-478e-a880-887e596dd53e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:34.755562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3dfa6667-60bf-478e-a880-887e596dd53e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.083580 Jan 11 14:22:34.756971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 654/1288] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:34 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:35.060218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:35.060733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:35.067965 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:35.068562 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:35.069931 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:35.070428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:35.212866 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:35.220951 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:35.222653 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:35.224356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0ca8bcf4-4724-479d-bf23-174ee2f511a4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.167997 Jan 11 14:22:35.224900 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 635/1289] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:35 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:35.766765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6a6b0ac6-1bc4-42fb-9325-63448bc989fc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:35.767787 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6a6b0ac6-1bc4-42fb-9325-63448bc989fc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:35.775210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a6b0ac6-1bc4-42fb-9325-63448bc989fc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:35.775691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a6b0ac6-1bc4-42fb-9325-63448bc989fc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:35.776507 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a6b0ac6-1bc4-42fb-9325-63448bc989fc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:35.776948 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6a6b0ac6-1bc4-42fb-9325-63448bc989fc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:36.242868 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:36.243471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:36.249799 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:36.250256 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:36.251039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:36.251479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:36.387898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:36.396184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:36.397717 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:36.398893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-56c2bef9-2693-45d4-91a5-0b280ad6a2c7 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.160370 Jan 11 14:22:36.401503 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 636/1290] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:36 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:37.417066 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:37.417717 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:37.424296 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:37.424606 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:37.425404 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:37.425846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:37.568133 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:37.577191 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:37.578748 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:37.580053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-aa7221f1-410b-42b9-8d95-6cdc147360ab tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.166636 Jan 11 14:22:37.580690 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 637/1291] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:37 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:38.598007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:38.598854 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:38.606608 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:38.607679 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:38.609070 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:38.609469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:38.749300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:38.758056 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:38.759636 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:38.760806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f4ef8c00-7408-4950-a0ed-8cc14df054f5 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.166558 Jan 11 14:22:38.761359 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 638/1292] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:38 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:39.779140 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:39.779844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:39.786290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:39.786788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:39.787666 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:39.789360 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:39.936492 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:39.944412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:39.945937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:39.947101 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5e2b489f-498b-4dc2-a91d-418a90a17903 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.171690 Jan 11 14:22:39.947690 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 639/1293] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:39 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:40.965676 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:40.966315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:40.972569 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:40.973008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:40.973788 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:40.974248 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:41.106914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:41.114870 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:41.117004 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:41.118165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-15371db1-e02d-48a7-85b8-00b3c54dfac1 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.156450 Jan 11 14:22:41.118710 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 640/1294] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:40 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:42.136479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:42.137119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:42.143750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:42.144202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:42.145022 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:42.145460 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:42.278404 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:42.286853 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:42.289071 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:42.290283 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-29413fa3-1557-4822-a2b6-13565e09e8cf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.157640 Jan 11 14:22:42.291089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 641/1295] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:42 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:43.309183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:43.309956 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:43.316955 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:43.317418 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:43.318211 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:43.318655 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:43.455402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:43.464305 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:43.465808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:43.467262 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-45cdf76a-0727-4824-878f-e5b7a1eb6110 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.161714 Jan 11 14:22:43.468158 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 642/1296] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:43 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:44.486103 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:44.486774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:44.493052 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:44.493504 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:44.494277 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:44.494712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:44.620575 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:44.628170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:44.629686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:44.630837 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-92b1ca5f-855d-41bd-93fc-9f1310c47fc9 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.148503 Jan 11 14:22:44.631389 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 643/1297] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:44 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:45.648580 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:45.649243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:45.655459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:45.655942 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:45.656722 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:45.657155 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:45.790885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:45.798643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:45.800215 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:45.801363 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4242a19e-dca6-4db9-9f70-5844a193802a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.156826 Jan 11 14:22:45.801910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 644/1298] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:45 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:46.818867 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:46.819535 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:46.826678 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:46.827127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:46.827939 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:46.828374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:46.948894 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6a6b0ac6-1bc4-42fb-9325-63448bc989fc tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 11.185992 Jan 11 14:22:46.950993 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 655/1299] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:35 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 11189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:46.960502 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:46.968239 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:46.969739 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:46.970880 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b3f63e0b-6d4f-4139-a338-10926946157a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.155870 Jan 11 14:22:46.971436 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 645/1300] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:46 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:47.962733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-464da1b2-8d7c-49e4-a62f-bcdb98a1ac9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:47.963684 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-464da1b2-8d7c-49e4-a62f-bcdb98a1ac9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:47.971115 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-464da1b2-8d7c-49e4-a62f-bcdb98a1ac9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:47.971593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-464da1b2-8d7c-49e4-a62f-bcdb98a1ac9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:47.972371 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-464da1b2-8d7c-49e4-a62f-bcdb98a1ac9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:47.972801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-464da1b2-8d7c-49e4-a62f-bcdb98a1ac9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:47.989052 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:47.989690 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:47.996377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:47.996825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:47.997602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:47.998042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:48.095443 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-464da1b2-8d7c-49e4-a62f-bcdb98a1ac9a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.137264 Jan 11 14:22:48.097539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 656/1301] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:47 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:48.134515 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:48.145816 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:48.146284 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:48.147961 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-af8d97a2-62c5-4924-9625-3926ffeae61a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.162577 Jan 11 14:22:48.148534 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 646/1302] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:47 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:49.108957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d1f99143-4615-42b1-812e-9be2cbba81cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:49.109912 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d1f99143-4615-42b1-812e-9be2cbba81cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:49.116936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1f99143-4615-42b1-812e-9be2cbba81cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:49.117379 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1f99143-4615-42b1-812e-9be2cbba81cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:49.118149 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1f99143-4615-42b1-812e-9be2cbba81cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:49.118580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d1f99143-4615-42b1-812e-9be2cbba81cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:49.165876 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:49.166481 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:49.172633 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:49.173076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:49.173849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:49.174283 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:49.206035 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d1f99143-4615-42b1-812e-9be2cbba81cd tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.100970 Jan 11 14:22:49.206708 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 657/1303] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:49 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:49.302545 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:49.310138 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:49.311695 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:49.312847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-96e4dd88-1ea6-4eda-9c09-12a839ea2598 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.150686 Jan 11 14:22:49.313409 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 647/1304] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:49 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:50.218501 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bc065914-077f-4cdb-ae53-b4313207987c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:50.219584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-bc065914-077f-4cdb-ae53-b4313207987c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:50.227656 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bc065914-077f-4cdb-ae53-b4313207987c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:50.228109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bc065914-077f-4cdb-ae53-b4313207987c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:50.228893 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bc065914-077f-4cdb-ae53-b4313207987c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:50.229316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-bc065914-077f-4cdb-ae53-b4313207987c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:50.292957 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bc065914-077f-4cdb-ae53-b4313207987c tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.078124 Jan 11 14:22:50.293517 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 658/1305] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:50 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:50.331394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:50.332029 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:50.338766 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:50.339213 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:50.340011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:50.340445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:50.471566 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:50.479843 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:50.481356 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:50.482507 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a57ee2e7-190a-4040-922b-b31e691d42fe tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.154849 Jan 11 14:22:50.483053 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 648/1306] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:50 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:51.306303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8a224d16-ecf5-4461-a949-a2d639074463 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:51.307311 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8a224d16-ecf5-4461-a949-a2d639074463 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:51.313824 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8a224d16-ecf5-4461-a949-a2d639074463 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:51.314272 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8a224d16-ecf5-4461-a949-a2d639074463 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:51.315049 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8a224d16-ecf5-4461-a949-a2d639074463 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:51.315484 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8a224d16-ecf5-4461-a949-a2d639074463 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:51.461226 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8a224d16-ecf5-4461-a949-a2d639074463 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.160237 Jan 11 14:22:51.461874 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 659/1307] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:51 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:51.500151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:51.500768 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:51.507010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:51.507462 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:51.508441 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:51.509200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:51.638650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:51.646325 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:51.647884 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:51.649024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-bd1ba1c1-0a03-47eb-b551-6c6c3d964edc tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.152576 Jan 11 14:22:51.649570 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 649/1308] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:51 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:52.181251 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-bbef5ec9-e02a-48f9-a4cd-3d3f4b218396 req-ca3212e8-4b08-45a6-9ab6-b612b45110b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a120e67-9697-421a-a7ab-8d249487dc97", "name": "network-vif-plugged", "status": "completed", "tag": "f98a27e9-7200-41e6-947a-d46ac07ecfd5"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:52.182772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:22:52.182772 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:22:52.191380 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-bbef5ec9-e02a-48f9-a4cd-3d3f4b218396 req-ca3212e8-4b08-45a6-9ab6-b612b45110b2 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:52.191983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-bbef5ec9-e02a-48f9-a4cd-3d3f4b218396 req-ca3212e8-4b08-45a6-9ab6-b612b45110b2 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:52.204349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-bbef5ec9-e02a-48f9-a4cd-3d3f4b218396 req-ca3212e8-4b08-45a6-9ab6-b612b45110b2 service nova] Creating event network-vif-plugged:f98a27e9-7200-41e6-947a-d46ac07ecfd5 for instance 3a120e67-9697-421a-a7ab-8d249487dc97 on hv-cinder-82413 Jan 11 14:22:52.209019 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-bbef5ec9-e02a-48f9-a4cd-3d3f4b218396 req-ca3212e8-4b08-45a6-9ab6-b612b45110b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031755 Jan 11 14:22:52.209603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 660/1309] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:22:52.472728 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-534a1292-f378-44ce-9c8f-248188c7b682 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:52.473727 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-534a1292-f378-44ce-9c8f-248188c7b682 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:52.479587 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-534a1292-f378-44ce-9c8f-248188c7b682 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:52.480043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-534a1292-f378-44ce-9c8f-248188c7b682 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:52.480825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-534a1292-f378-44ce-9c8f-248188c7b682 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:52.481292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-534a1292-f378-44ce-9c8f-248188c7b682 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:52.667627 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:52.668344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:52.674332 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:52.674775 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:52.675564 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:52.675995 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:52.791846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-534a1292-f378-44ce-9c8f-248188c7b682 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.322620 Jan 11 14:22:52.792500 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 650/1310] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:52 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:52.809544 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:52.817301 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:52.818804 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:52.820004 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c5fd5366-a677-47f0-9deb-600c490f9250 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.156929 Jan 11 14:22:52.821213 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 661/1311] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:52 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 14:22:53.804381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-26bf4edc-e314-42e0-8d18-0a2044a7c9bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:53.805411 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-26bf4edc-e314-42e0-8d18-0a2044a7c9bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:53.812299 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-26bf4edc-e314-42e0-8d18-0a2044a7c9bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:53.812754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-26bf4edc-e314-42e0-8d18-0a2044a7c9bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:53.813533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-26bf4edc-e314-42e0-8d18-0a2044a7c9bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:53.813969 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-26bf4edc-e314-42e0-8d18-0a2044a7c9bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:53.838728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:53.839366 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:53.845793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:53.846237 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:53.847014 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:53.847441 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:53.892978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-26bf4edc-e314-42e0-8d18-0a2044a7c9bb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.092628 Jan 11 14:22:53.893761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 651/1312] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:53 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:53.981474 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:53.989336 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:53.990936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:53.992109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0b5ed628-7b48-4173-9d3f-851613836e3a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1730 microversion: 2.20 time: 0.157857 Jan 11 14:22:53.992651 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 662/1313] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:53 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:54.905315 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-36f61738-233b-483d-b718-1336d311e201 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:54.906319 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-36f61738-233b-483d-b718-1336d311e201 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:54.913144 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36f61738-233b-483d-b718-1336d311e201 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:54.913598 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36f61738-233b-483d-b718-1336d311e201 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:54.914383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36f61738-233b-483d-b718-1336d311e201 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:54.914825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-36f61738-233b-483d-b718-1336d311e201 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:54.982352 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-36f61738-233b-483d-b718-1336d311e201 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 28656 microversion: 2.1 time: 0.080882 Jan 11 14:22:54.982898 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 652/1314] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:54 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 28656 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:55.009854 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:22:55.010466 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:55.016749 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:55.017199 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:55.017976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:55.018410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:55.151469 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:55.159239 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:55.160784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:22:55.161928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6c1db7bc-b22f-493b-9339-fdaa9bd95d7c tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1717 microversion: 2.20 time: 0.155894 Jan 11 14:22:55.162483 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 663/1315] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:22:55 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:22:55.995009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-56e8ecc4-7397-4d1a-9c86-3d7ad5c3fdc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:55.996026 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-56e8ecc4-7397-4d1a-9c86-3d7ad5c3fdc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:56.002775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-56e8ecc4-7397-4d1a-9c86-3d7ad5c3fdc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:56.003225 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-56e8ecc4-7397-4d1a-9c86-3d7ad5c3fdc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:56.004036 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-56e8ecc4-7397-4d1a-9c86-3d7ad5c3fdc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:56.004478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-56e8ecc4-7397-4d1a-9c86-3d7ad5c3fdc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:56.087665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-56e8ecc4-7397-4d1a-9c86-3d7ad5c3fdc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 29907 microversion: 2.1 time: 0.097197 Jan 11 14:22:56.088445 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 653/1316] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:55 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 29907 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:57.099701 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a818fa36-4795-4eaa-a764-3982c38dba49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:57.101105 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a818fa36-4795-4eaa-a764-3982c38dba49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:57.107355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a818fa36-4795-4eaa-a764-3982c38dba49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:57.107831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a818fa36-4795-4eaa-a764-3982c38dba49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:57.108615 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a818fa36-4795-4eaa-a764-3982c38dba49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:57.109051 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a818fa36-4795-4eaa-a764-3982c38dba49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:57.189551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a818fa36-4795-4eaa-a764-3982c38dba49 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 32014 microversion: 2.1 time: 0.093491 Jan 11 14:22:57.190196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 664/1317] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:57 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 32014 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:58.202403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5796b702-5011-465c-8630-219c3c309018 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:58.203397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-5796b702-5011-465c-8630-219c3c309018 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:58.210252 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5796b702-5011-465c-8630-219c3c309018 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:58.210701 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5796b702-5011-465c-8630-219c3c309018 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:58.211475 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5796b702-5011-465c-8630-219c3c309018 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:58.211935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-5796b702-5011-465c-8630-219c3c309018 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:58.287935 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5796b702-5011-465c-8630-219c3c309018 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 33103 microversion: 2.1 time: 0.089618 Jan 11 14:22:58.288579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 654/1318] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:58 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 33103 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:22:59.300125 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1994918a-d09d-48ce-aab2-591509f58da4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:22:59.301138 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1994918a-d09d-48ce-aab2-591509f58da4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:22:59.307968 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1994918a-d09d-48ce-aab2-591509f58da4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:59.308421 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1994918a-d09d-48ce-aab2-591509f58da4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:59.309207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1994918a-d09d-48ce-aab2-591509f58da4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:22:59.309642 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1994918a-d09d-48ce-aab2-591509f58da4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:22:59.381015 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1994918a-d09d-48ce-aab2-591509f58da4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 34160 microversion: 2.1 time: 0.084888 Jan 11 14:22:59.381645 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 665/1319] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:22:59 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 34160 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:23:00.394024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6ed385e8-0432-43fb-a305-e959c47f3ba0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:00.395019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6ed385e8-0432-43fb-a305-e959c47f3ba0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:00.401879 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6ed385e8-0432-43fb-a305-e959c47f3ba0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:00.402333 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6ed385e8-0432-43fb-a305-e959c47f3ba0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:00.403119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6ed385e8-0432-43fb-a305-e959c47f3ba0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:00.403583 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6ed385e8-0432-43fb-a305-e959c47f3ba0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:00.492291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6ed385e8-0432-43fb-a305-e959c47f3ba0 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 35390 microversion: 2.1 time: 0.102206 Jan 11 14:23:00.492925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 655/1320] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:23:00 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 35390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:23:01.504914 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e004b357-ad91-4614-86a7-72f7bb74b55b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:01.505902 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e004b357-ad91-4614-86a7-72f7bb74b55b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:01.513224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e004b357-ad91-4614-86a7-72f7bb74b55b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:01.513663 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e004b357-ad91-4614-86a7-72f7bb74b55b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:01.514430 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e004b357-ad91-4614-86a7-72f7bb74b55b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:01.514859 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e004b357-ad91-4614-86a7-72f7bb74b55b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:01.585515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e004b357-ad91-4614-86a7-72f7bb74b55b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 36890 microversion: 2.1 time: 0.084466 Jan 11 14:23:01.586163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 666/1321] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:23:01 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 36890 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:23:02.598432 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-80cd632b-2d4d-43f9-9699-5951c623e825 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:02.599335 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-80cd632b-2d4d-43f9-9699-5951c623e825 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:02.606644 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80cd632b-2d4d-43f9-9699-5951c623e825 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:02.607117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80cd632b-2d4d-43f9-9699-5951c623e825 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:02.607912 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80cd632b-2d4d-43f9-9699-5951c623e825 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:02.608374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80cd632b-2d4d-43f9-9699-5951c623e825 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:02.677988 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-80cd632b-2d4d-43f9-9699-5951c623e825 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 38190 microversion: 2.1 time: 0.083554 Jan 11 14:23:02.678888 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 656/1322] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:23:02 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 38190 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:23:03.689514 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-60fa34eb-4522-4608-b6a1-fbea36c90abe tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:03.690503 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-60fa34eb-4522-4608-b6a1-fbea36c90abe tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:03.697985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-60fa34eb-4522-4608-b6a1-fbea36c90abe tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:03.698433 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-60fa34eb-4522-4608-b6a1-fbea36c90abe tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:03.699208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-60fa34eb-4522-4608-b6a1-fbea36c90abe tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:03.699676 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-60fa34eb-4522-4608-b6a1-fbea36c90abe tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:03.777556 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-60fa34eb-4522-4608-b6a1-fbea36c90abe tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 38190 microversion: 2.1 time: 0.091954 Jan 11 14:23:03.778213 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 667/1323] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:23:03 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 38190 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:23:04.789831 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8e0d99b1-d944-4fe0-931b-32934ae89f7f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:04.790832 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8e0d99b1-d944-4fe0-931b-32934ae89f7f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:04.797847 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e0d99b1-d944-4fe0-931b-32934ae89f7f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:04.798301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e0d99b1-d944-4fe0-931b-32934ae89f7f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:04.799095 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e0d99b1-d944-4fe0-931b-32934ae89f7f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:04.799555 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8e0d99b1-d944-4fe0-931b-32934ae89f7f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:04.863344 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8e0d99b1-d944-4fe0-931b-32934ae89f7f tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 38190 microversion: 2.1 time: 0.077478 Jan 11 14:23:04.864002 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 657/1324] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:23:04 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 38190 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:23:06.002549 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-118129da-944d-4cf6-8fef-fa9b00dcd72a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:06.003247 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-118129da-944d-4cf6-8fef-fa9b00dcd72a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:06.010965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-118129da-944d-4cf6-8fef-fa9b00dcd72a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:06.011415 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-118129da-944d-4cf6-8fef-fa9b00dcd72a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:06.012236 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-118129da-944d-4cf6-8fef-fa9b00dcd72a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:06.012672 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-118129da-944d-4cf6-8fef-fa9b00dcd72a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:06.076088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-118129da-944d-4cf6-8fef-fa9b00dcd72a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 38190 microversion: 2.1 time: 0.204170 Jan 11 14:23:06.076692 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 668/1325] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:23:05 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 38190 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:23:07.088844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-23553a1d-71e2-45f2-ad35-d18c05e2ae36 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:07.089861 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-23553a1d-71e2-45f2-ad35-d18c05e2ae36 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:07.096746 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-23553a1d-71e2-45f2-ad35-d18c05e2ae36 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:07.097204 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-23553a1d-71e2-45f2-ad35-d18c05e2ae36 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:07.098000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-23553a1d-71e2-45f2-ad35-d18c05e2ae36 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:07.098438 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-23553a1d-71e2-45f2-ad35-d18c05e2ae36 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:07.177443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-23553a1d-71e2-45f2-ad35-d18c05e2ae36 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action" status: 200 len: 38321 microversion: 2.1 time: 0.092984 Jan 11 14:23:07.178106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 658/1326] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:23:07 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/action => generated 38321 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 14:23:07.188308 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-65152991-8d54-4d7d-833e-4dd002bffb4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:07.188966 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-65152991-8d54-4d7d-833e-4dd002bffb4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:07.195769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-65152991-8d54-4d7d-833e-4dd002bffb4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:07.196223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-65152991-8d54-4d7d-833e-4dd002bffb4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:07.197017 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-65152991-8d54-4d7d-833e-4dd002bffb4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:07.197451 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-65152991-8d54-4d7d-833e-4dd002bffb4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:07.221663 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-65152991-8d54-4d7d-833e-4dd002bffb4a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/ips" status: 200 len: 146 microversion: 2.1 time: 0.037429 Jan 11 14:23:07.222233 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 669/1327] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Jan 11 14:23:07 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:08.524469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-405a7c5b-ec37-473c-b24c-db0d0473127a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c787ffb1-a2c6-42a8-afee-0950ae052d59"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:08.525631 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-405a7c5b-ec37-473c-b24c-db0d0473127a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:08.532369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-405a7c5b-ec37-473c-b24c-db0d0473127a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:08.532810 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-405a7c5b-ec37-473c-b24c-db0d0473127a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:08.533579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-405a7c5b-ec37-473c-b24c-db0d0473127a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:08.534009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-405a7c5b-ec37-473c-b24c-db0d0473127a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:08.856206 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-405a7c5b-ec37-473c-b24c-db0d0473127a tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335677 Jan 11 14:23:08.856836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 659/1328] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:23:08 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:16.312606 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1b277b2c-9c73-450e-90fb-a99eb8f8ad46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:16.313525 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1b277b2c-9c73-450e-90fb-a99eb8f8ad46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:16.319768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1b277b2c-9c73-450e-90fb-a99eb8f8ad46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:16.320221 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1b277b2c-9c73-450e-90fb-a99eb8f8ad46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:16.320996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1b277b2c-9c73-450e-90fb-a99eb8f8ad46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:16.321432 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1b277b2c-9c73-450e-90fb-a99eb8f8ad46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:16.356623 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1b277b2c-9c73-450e-90fb-a99eb8f8ad46 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047765 Jan 11 14:23:16.357176 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 670/1329] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:23:16 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:16.367691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2719e888-6167-4daa-bd9e-357f43eb5e4d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:16.368274 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2719e888-6167-4daa-bd9e-357f43eb5e4d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:16.374220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2719e888-6167-4daa-bd9e-357f43eb5e4d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:16.374673 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2719e888-6167-4daa-bd9e-357f43eb5e4d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:16.375444 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2719e888-6167-4daa-bd9e-357f43eb5e4d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:16.375914 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2719e888-6167-4daa-bd9e-357f43eb5e4d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:16.403844 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2719e888-6167-4daa-bd9e-357f43eb5e4d tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/c787ffb1-a2c6-42a8-afee-0950ae052d59" status: 200 len: 194 microversion: 2.1 time: 0.040697 Jan 11 14:23:16.404413 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 660/1330] 10.222.0.49 () {58 vars in 1412 bytes} [Tue Jan 11 14:23:16 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/c787ffb1-a2c6-42a8-afee-0950ae052d59 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:17.697098 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5b2d072b-5c2b-402c-9b50-bfa3e42e4fc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "243a727d-0676-4605-8d61-986b64705f22"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:17.698162 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5b2d072b-5c2b-402c-9b50-bfa3e42e4fc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:17.704906 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5b2d072b-5c2b-402c-9b50-bfa3e42e4fc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:17.705373 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5b2d072b-5c2b-402c-9b50-bfa3e42e4fc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:17.706167 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5b2d072b-5c2b-402c-9b50-bfa3e42e4fc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:17.706608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5b2d072b-5c2b-402c-9b50-bfa3e42e4fc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:17.976629 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5b2d072b-5c2b-402c-9b50-bfa3e42e4fc4 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283154 Jan 11 14:23:17.977208 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 671/1331] 10.222.0.49 () {60 vars in 1322 bytes} [Tue Jan 11 14:23:17 2022] POST /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:25.422362 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2ed3c31d-bfc5-4211-90ff-1847c7c822ae tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:25.423265 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2ed3c31d-bfc5-4211-90ff-1847c7c822ae tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:25.429625 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ed3c31d-bfc5-4211-90ff-1847c7c822ae tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:25.430074 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ed3c31d-bfc5-4211-90ff-1847c7c822ae tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:25.430857 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ed3c31d-bfc5-4211-90ff-1847c7c822ae tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:25.431296 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2ed3c31d-bfc5-4211-90ff-1847c7c822ae tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:25.460554 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2ed3c31d-bfc5-4211-90ff-1847c7c822ae tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041976 Jan 11 14:23:25.461099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 661/1332] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:23:25 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:25.711922 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3310c6ad-bd7e-4beb-a73f-eb960a54f253 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:25.712502 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3310c6ad-bd7e-4beb-a73f-eb960a54f253 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:25.718562 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3310c6ad-bd7e-4beb-a73f-eb960a54f253 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:25.719018 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3310c6ad-bd7e-4beb-a73f-eb960a54f253 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:25.719831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3310c6ad-bd7e-4beb-a73f-eb960a54f253 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:25.720273 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3310c6ad-bd7e-4beb-a73f-eb960a54f253 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:25.748909 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3310c6ad-bd7e-4beb-a73f-eb960a54f253 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/c787ffb1-a2c6-42a8-afee-0950ae052d59" status: 200 len: 194 microversion: 2.1 time: 0.041672 Jan 11 14:23:25.749643 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 672/1333] 10.222.0.49 () {58 vars in 1412 bytes} [Tue Jan 11 14:23:25 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/c787ffb1-a2c6-42a8-afee-0950ae052d59 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:25.758718 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-68adcdd7-cb2e-45ed-92f5-361d433fef34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:25.759214 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-68adcdd7-cb2e-45ed-92f5-361d433fef34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:25.765475 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-68adcdd7-cb2e-45ed-92f5-361d433fef34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:25.765929 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-68adcdd7-cb2e-45ed-92f5-361d433fef34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:25.766714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-68adcdd7-cb2e-45ed-92f5-361d433fef34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:25.767153 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-68adcdd7-cb2e-45ed-92f5-361d433fef34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:25.842276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-68adcdd7-cb2e-45ed-92f5-361d433fef34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lazy-loading 'services' on Instance uuid 4a0b9346-4e10-4ad4-95ae-5a822de41dad {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:23:25.908838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-68adcdd7-cb2e-45ed-92f5-361d433fef34 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/c787ffb1-a2c6-42a8-afee-0950ae052d59" status: 202 len: 0 microversion: 2.1 time: 0.153637 Jan 11 14:23:25.909407 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 662/1334] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:23:25 2022] DELETE /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/c787ffb1-a2c6-42a8-afee-0950ae052d59 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:23:27.016664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6bba5736-f3fe-4111-8451-8268d2c15039 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:27.017166 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6bba5736-f3fe-4111-8451-8268d2c15039 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:27.023274 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6bba5736-f3fe-4111-8451-8268d2c15039 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:27.023763 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6bba5736-f3fe-4111-8451-8268d2c15039 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:27.024545 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6bba5736-f3fe-4111-8451-8268d2c15039 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:27.024983 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6bba5736-f3fe-4111-8451-8268d2c15039 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:27.052930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6bba5736-f3fe-4111-8451-8268d2c15039 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/243a727d-0676-4605-8d61-986b64705f22" status: 200 len: 194 microversion: 2.1 time: 0.040029 Jan 11 14:23:27.053501 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 673/1335] 10.222.0.49 () {58 vars in 1412 bytes} [Tue Jan 11 14:23:27 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/243a727d-0676-4605-8d61-986b64705f22 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:27.064348 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-54053e5a-b5dd-4ce5-8c2d-c112cd9c8444 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:27.064927 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-54053e5a-b5dd-4ce5-8c2d-c112cd9c8444 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:27.070901 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54053e5a-b5dd-4ce5-8c2d-c112cd9c8444 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:27.071361 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54053e5a-b5dd-4ce5-8c2d-c112cd9c8444 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:27.072167 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54053e5a-b5dd-4ce5-8c2d-c112cd9c8444 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:27.072605 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-54053e5a-b5dd-4ce5-8c2d-c112cd9c8444 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:27.147412 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-54053e5a-b5dd-4ce5-8c2d-c112cd9c8444 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lazy-loading 'services' on Instance uuid 4a0b9346-4e10-4ad4-95ae-5a822de41dad {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:23:27.214821 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-54053e5a-b5dd-4ce5-8c2d-c112cd9c8444 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/243a727d-0676-4605-8d61-986b64705f22" status: 202 len: 0 microversion: 2.1 time: 0.154865 Jan 11 14:23:27.215471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 663/1336] 10.222.0.49 () {58 vars in 1415 bytes} [Tue Jan 11 14:23:27 2022] DELETE /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments/243a727d-0676-4605-8d61-986b64705f22 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:23:28.364653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3efe4b3b-6ce0-480e-b993-1cf2cbfeb159 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:28.365597 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3efe4b3b-6ce0-480e-b993-1cf2cbfeb159 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:28.371767 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3efe4b3b-6ce0-480e-b993-1cf2cbfeb159 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:28.372210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3efe4b3b-6ce0-480e-b993-1cf2cbfeb159 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:28.373010 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3efe4b3b-6ce0-480e-b993-1cf2cbfeb159 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:28.373435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3efe4b3b-6ce0-480e-b993-1cf2cbfeb159 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:28.402393 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3efe4b3b-6ce0-480e-b993-1cf2cbfeb159 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041480 Jan 11 14:23:28.402946 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 674/1337] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:23:28 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:23:28.502212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d363bc18-d75f-4a3f-b151-858dd34ec061 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:28.503260 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d363bc18-d75f-4a3f-b151-858dd34ec061 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:28.509273 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d363bc18-d75f-4a3f-b151-858dd34ec061 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:28.509726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d363bc18-d75f-4a3f-b151-858dd34ec061 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:28.511007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d363bc18-d75f-4a3f-b151-858dd34ec061 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:28.511444 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d363bc18-d75f-4a3f-b151-858dd34ec061 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:28.540213 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d363bc18-d75f-4a3f-b151-858dd34ec061 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042928 Jan 11 14:23:28.540682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 664/1338] 10.222.0.49 () {58 vars in 1301 bytes} [Tue Jan 11 14:23:28 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 14:23:28.593677 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-824ff052-b367-4ed7-ba47-c6916f3e488b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:28.594164 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-824ff052-b367-4ed7-ba47-c6916f3e488b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:28.599765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-824ff052-b367-4ed7-ba47-c6916f3e488b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:28.600207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-824ff052-b367-4ed7-ba47-c6916f3e488b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:28.600981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-824ff052-b367-4ed7-ba47-c6916f3e488b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:28.601413 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-824ff052-b367-4ed7-ba47-c6916f3e488b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:28.626288 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-824ff052-b367-4ed7-ba47-c6916f3e488b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:23:28.696241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-824ff052-b367-4ed7-ba47-c6916f3e488b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 204 len: 0 microversion: 2.1 time: 0.105889 Jan 11 14:23:28.697303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 675/1339] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:23:28 2022] DELETE /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:23:28.708477 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7e82ac7b-66bb-46d8-9fed-396ed43f5334 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:28.709092 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-7e82ac7b-66bb-46d8-9fed-396ed43f5334 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:28.715662 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e82ac7b-66bb-46d8-9fed-396ed43f5334 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:28.716114 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e82ac7b-66bb-46d8-9fed-396ed43f5334 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:28.716895 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e82ac7b-66bb-46d8-9fed-396ed43f5334 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:28.717333 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-7e82ac7b-66bb-46d8-9fed-396ed43f5334 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:28.843723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-7e82ac7b-66bb-46d8-9fed-396ed43f5334 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:23:28.851024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7e82ac7b-66bb-46d8-9fed-396ed43f5334 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1674 microversion: 2.1 time: 0.147588 Jan 11 14:23:28.851628 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 665/1340] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:23:28 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:23:29.867950 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4091df4d-6d23-4358-bbcc-a5686fcffefb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:29.868605 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-4091df4d-6d23-4358-bbcc-a5686fcffefb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:29.874842 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4091df4d-6d23-4358-bbcc-a5686fcffefb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:29.875289 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4091df4d-6d23-4358-bbcc-a5686fcffefb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:29.876098 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4091df4d-6d23-4358-bbcc-a5686fcffefb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:29.876531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-4091df4d-6d23-4358-bbcc-a5686fcffefb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:30.010207 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-4091df4d-6d23-4358-bbcc-a5686fcffefb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:23:30.017492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4091df4d-6d23-4358-bbcc-a5686fcffefb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1674 microversion: 2.1 time: 0.153712 Jan 11 14:23:30.018050 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 676/1341] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:23:29 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:23:31.034664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-068fd695-d21f-49d9-b707-fc5f647ed7af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:31.035099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-068fd695-d21f-49d9-b707-fc5f647ed7af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:31.041521 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-068fd695-d21f-49d9-b707-fc5f647ed7af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:31.042617 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-068fd695-d21f-49d9-b707-fc5f647ed7af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:31.043404 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-068fd695-d21f-49d9-b707-fc5f647ed7af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:31.043899 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-068fd695-d21f-49d9-b707-fc5f647ed7af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:31.170815 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-068fd695-d21f-49d9-b707-fc5f647ed7af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:23:31.178071 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-068fd695-d21f-49d9-b707-fc5f647ed7af tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1674 microversion: 2.1 time: 0.147339 Jan 11 14:23:31.178636 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 666/1342] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:23:31 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:23:31.832223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-4f132b90-e66e-4f83-8d75-736dad97a880 req-d417da66-ee7f-4b88-82e2-65f34106cf72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0b9346-4e10-4ad4-95ae-5a822de41dad", "name": "network-vif-deleted", "tag": "c4542d74-4b8d-4592-a074-26f4696dd8e0"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:23:31.833996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:23:31.833996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:23:31.843905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-4f132b90-e66e-4f83-8d75-736dad97a880 req-d417da66-ee7f-4b88-82e2-65f34106cf72 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:31.844351 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-4f132b90-e66e-4f83-8d75-736dad97a880 req-d417da66-ee7f-4b88-82e2-65f34106cf72 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:31.857746 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-4f132b90-e66e-4f83-8d75-736dad97a880 req-d417da66-ee7f-4b88-82e2-65f34106cf72 service nova] Creating event network-vif-deleted:c4542d74-4b8d-4592-a074-26f4696dd8e0 for instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad on hv-cinder-82413 Jan 11 14:23:31.864137 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-4f132b90-e66e-4f83-8d75-736dad97a880 req-d417da66-ee7f-4b88-82e2-65f34106cf72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035372 Jan 11 14:23:31.864738 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 677/1343] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:23:32.195136 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:32.195825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:32.202181 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:32.202625 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:32.203396 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:32.203855 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:32.235386 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:32.235859 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:32.236312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lazy-loading 'fault' on Instance uuid 4a0b9346-4e10-4ad4-95ae-5a822de41dad {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:23:32.280749 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b016e5f2694c90821eb0eb80e3dc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a11f6957ee74ff0a62315613ff54913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:23:32.289629 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-33173575-5cff-4b2e-a77c-d70b451be07e tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 200 len: 1327 microversion: 2.1 time: 0.098107 Jan 11 14:23:32.290383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 667/1344] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:23:32 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:23:33.308164 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:33.308793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:33.315158 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:33.315645 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:33.316422 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:33.316857 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:33.330553 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] HTTP exception thrown: Instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad could not be found. Jan 11 14:23:33.331133 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Returning 404 to user: Instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:23:33.331981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a3eec3f3-b985-4fba-89ad-f8b80930698b tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 404 len: 111 microversion: 2.1 time: 0.028575 Jan 11 14:23:33.332492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 678/1345] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:23:33 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:23:33.340723 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-190725da-f7c8-4078-8aa7-0f00b28240d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '.version_select at 0x7fba91395ca0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:33.357790 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-190725da-f7c8-4078-8aa7-0f00b28240d7 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845690865" status: 202 len: 0 microversion: 2.1 time: 0.020686 Jan 11 14:23:33.358388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 668/1346] 10.222.0.49 () {58 vars in 1217 bytes} [Tue Jan 11 14:23:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845690865 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:23:36.221074 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:36.221552 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:36.227866 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:36.228319 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:36.229136 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:36.229573 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:36.242945 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] HTTP exception thrown: Instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad could not be found. Jan 11 14:23:36.243539 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Returning 404 to user: Instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:23:36.244348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-53a56bf5-c38d-4807-bbe6-ef8c4fc97796 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 404 len: 111 microversion: 2.1 time: 0.027039 Jan 11 14:23:36.244868 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 679/1347] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:23:36 2022] DELETE /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:23:36.252792 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:36.253401 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: 4a0b9346-4e10-4ad4-95ae-5a822de41dad] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:36.259979 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:36.260979 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:36.261761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:36.262192 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:36.274908 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] HTTP exception thrown: Instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad could not be found. Jan 11 14:23:36.275485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Returning 404 to user: Instance 4a0b9346-4e10-4ad4-95ae-5a822de41dad could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:23:36.276978 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-331d987f-2e75-49bd-b942-cc7b4a6c9aeb tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad" status: 404 len: 111 microversion: 2.1 time: 0.028298 Jan 11 14:23:36.277488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 669/1348] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:23:36 2022] GET /compute/v2.1/servers/4a0b9346-4e10-4ad4-95ae-5a822de41dad => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:23:37.405971 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:37.406475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:37.413150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:37.413612 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:37.414395 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:37.414823 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:37.428924 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] HTTP exception thrown: Instance da33a406-0839-4a04-9800-1444f9ae0b82 could not be found. Jan 11 14:23:37.429443 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Returning 404 to user: Instance da33a406-0839-4a04-9800-1444f9ae0b82 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:23:37.430255 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-034cedce-6af5-4d36-866b-630e15f04433 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "DELETE /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 404 len: 111 microversion: 2.1 time: 0.027956 Jan 11 14:23:37.430787 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 680/1349] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:23:37 2022] DELETE /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:23:37.439179 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:23:37.439823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] [instance: da33a406-0839-4a04-9800-1444f9ae0b82] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:23:37.445990 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:37.446447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:37.447215 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:23:37.447712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:23:37.460602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] HTTP exception thrown: Instance da33a406-0839-4a04-9800-1444f9ae0b82 could not be found. Jan 11 14:23:37.461180 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] Returning 404 to user: Instance da33a406-0839-4a04-9800-1444f9ae0b82 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:23:37.461983 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-256ffa9d-f67f-4fb8-8eec-e61583573235 tempest-AttachVolumeTestJSON-943497530 tempest-AttachVolumeTestJSON-943497530-project] 10.222.0.49 "GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82" status: 404 len: 111 microversion: 2.1 time: 0.026476 Jan 11 14:23:37.462488 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 670/1350] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:23:37 2022] GET /compute/v2.1/servers/da33a406-0839-4a04-9800-1444f9ae0b82 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:24:00.186147 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-76a6e971-4304-4020-a8a8-807d837b3a0b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:00.186998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-76a6e971-4304-4020-a8a8-807d837b3a0b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:00.193291 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-76a6e971-4304-4020-a8a8-807d837b3a0b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:00.193744 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-76a6e971-4304-4020-a8a8-807d837b3a0b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:00.194534 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-76a6e971-4304-4020-a8a8-807d837b3a0b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:00.194972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-76a6e971-4304-4020-a8a8-807d837b3a0b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:00.223793 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-76a6e971-4304-4020-a8a8-807d837b3a0b tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042130 Jan 11 14:24:00.224338 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 681/1351] 10.222.0.49 () {60 vars in 1342 bytes} [Tue Jan 11 14:24:00 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:00.276867 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3cbbae63-c011-46d9-9d50-55cbfd612faf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:00.277874 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3cbbae63-c011-46d9-9d50-55cbfd612faf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:00.284075 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3cbbae63-c011-46d9-9d50-55cbfd612faf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:00.284521 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3cbbae63-c011-46d9-9d50-55cbfd612faf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:00.285341 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3cbbae63-c011-46d9-9d50-55cbfd612faf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:00.285774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3cbbae63-c011-46d9-9d50-55cbfd612faf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:00.309860 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3cbbae63-c011-46d9-9d50-55cbfd612faf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Going to try to terminate instance {{(pid=116475) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:24:00.381178 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3cbbae63-c011-46d9-9d50-55cbfd612faf tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 204 len: 0 microversion: 2.20 time: 0.107660 Jan 11 14:24:00.381782 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 671/1352] 10.222.0.49 () {60 vars in 1279 bytes} [Tue Jan 11 14:24:00 2022] DELETE /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 14:24:00.389965 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:00.390570 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:00.396354 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:00.396805 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:00.397579 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:00.398016 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:00.529193 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:00.536961 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:00.538479 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:00.539654 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f1740e9b-713f-4fdf-8e20-f3d42acf8a83 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.153428 Jan 11 14:24:00.540199 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 682/1353] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:24:00 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:24:01.559627 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:01.560422 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:01.567689 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:01.568290 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:01.569220 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:01.569664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:01.704921 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:01.714141 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:01.716307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:01.717729 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-59d05620-c5ef-45e3-92a6-f86879ec8c42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1723 microversion: 2.20 time: 0.162753 Jan 11 14:24:01.718375 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 672/1354] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:24:01 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:24:02.736164 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:02.736779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:02.742981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:02.743671 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:02.744653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:02.745254 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:02.823572 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:02.832454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:02.833972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '505b3b6c502d4deea89170e2dba2a029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e53c79af2d940ce87ec727feef0f0ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:02.835128 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-84096c5b-ca5a-4012-898b-9a9a53f7ed42 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 200 len: 1655 microversion: 2.20 time: 0.102755 Jan 11 14:24:02.836030 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 683/1355] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:24:02 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 1655 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 14:24:03.067930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-61e3aaf1-6850-4778-93a3-4a803b063459 req-b3523783-f102-43d0-b5df-763e504541d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a120e67-9697-421a-a7ab-8d249487dc97", "name": "network-vif-deleted", "tag": "f98a27e9-7200-41e6-947a-d46ac07ecfd5"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:24:03.069478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:24:03.069478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:24:03.077125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-61e3aaf1-6850-4778-93a3-4a803b063459 req-b3523783-f102-43d0-b5df-763e504541d7 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:03.077571 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-61e3aaf1-6850-4778-93a3-4a803b063459 req-b3523783-f102-43d0-b5df-763e504541d7 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:03.088910 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-61e3aaf1-6850-4778-93a3-4a803b063459 req-b3523783-f102-43d0-b5df-763e504541d7 service nova] Creating event network-vif-deleted:f98a27e9-7200-41e6-947a-d46ac07ecfd5 for instance 3a120e67-9697-421a-a7ab-8d249487dc97 on hv-cinder-82413 Jan 11 14:24:03.093888 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-61e3aaf1-6850-4778-93a3-4a803b063459 req-b3523783-f102-43d0-b5df-763e504541d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029537 Jan 11 14:24:03.097482 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 673/1356] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:24:03.853271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:03.853978 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:03.861323 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:03.861839 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:03.862692 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:03.863197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:03.880998 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] HTTP exception thrown: Instance 3a120e67-9697-421a-a7ab-8d249487dc97 could not be found. Jan 11 14:24:03.881736 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Returning 404 to user: Instance 3a120e67-9697-421a-a7ab-8d249487dc97 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:03.882682 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6046913a-15c6-45ff-b36b-405f8fe0bbe3 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 404 len: 111 microversion: 2.20 time: 0.033108 Jan 11 14:24:03.886473 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 684/1357] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:24:03 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:24:03.892069 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-52cff835-053e-4a72-b187-2959282af5e4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '.version_select at 0x7fba939dcdc0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:03.910387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-52cff835-053e-4a72-b187-2959282af5e4 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010323018" status: 204 len: 0 microversion: 2.20 time: 0.022201 Jan 11 14:24:03.911050 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 674/1358] 10.222.0.49 () {60 vars in 1261 bytes} [Tue Jan 11 14:24:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010323018 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 14:24:05.826056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:05.826600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:05.833964 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:05.834774 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:05.836053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:05.836497 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:05.851218 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] HTTP exception thrown: Instance 3a120e67-9697-421a-a7ab-8d249487dc97 could not be found. Jan 11 14:24:05.851836 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Returning 404 to user: Instance 3a120e67-9697-421a-a7ab-8d249487dc97 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:05.852688 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c044d65a-961c-4830-9d4d-9162831c834e tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 404 len: 111 microversion: 2.20 time: 0.031363 Jan 11 14:24:05.853219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 685/1359] 10.222.0.49 () {60 vars in 1279 bytes} [Tue Jan 11 14:24:05 2022] DELETE /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:24:05.861810 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:05.862474 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 3a120e67-9697-421a-a7ab-8d249487dc97] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:05.868737 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:05.869178 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:05.869947 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:05.870463 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:05.883907 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] HTTP exception thrown: Instance 3a120e67-9697-421a-a7ab-8d249487dc97 could not be found. Jan 11 14:24:05.884485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Returning 404 to user: Instance 3a120e67-9697-421a-a7ab-8d249487dc97 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:05.885284 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-51be2b0a-aa18-4d33-afcb-035b83f3c529 tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97" status: 404 len: 111 microversion: 2.20 time: 0.027377 Jan 11 14:24:05.885796 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 675/1360] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:24:05 2022] GET /compute/v2.1/servers/3a120e67-9697-421a-a7ab-8d249487dc97 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:24:07.017663 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:07.018328 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:07.025923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:07.026386 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:07.027369 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:07.027855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:07.044009 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] HTTP exception thrown: Instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 could not be found. Jan 11 14:24:07.044624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Returning 404 to user: Instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:07.045467 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ead9c910-7917-4a97-b531-47ada188058a tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 404 len: 111 microversion: 2.20 time: 0.031695 Jan 11 14:24:07.049145 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 686/1361] 10.222.0.49 () {60 vars in 1279 bytes} [Tue Jan 11 14:24:07 2022] DELETE /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:24:07.054559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:07.055172 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] [instance: 07361687-ec7a-4f6e-8e42-530c1a64ba04] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:07.066849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:07.067297 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:07.068125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:07.068726 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:07.087363 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] HTTP exception thrown: Instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 could not be found. Jan 11 14:24:07.088686 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] Returning 404 to user: Instance 07361687-ec7a-4f6e-8e42-530c1a64ba04 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:07.089524 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dd26ca10-627e-4fe8-abcf-53f04979afcb tempest-AttachVolumeShelveTestJSON-1613625756 tempest-AttachVolumeShelveTestJSON-1613625756-project] 10.222.0.49 "GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04" status: 404 len: 111 microversion: 2.20 time: 0.039259 Jan 11 14:24:07.090385 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 676/1362] 10.222.0.49 () {60 vars in 1276 bytes} [Tue Jan 11 14:24:07 2022] GET /compute/v2.1/servers/07361687-ec7a-4f6e-8e42-530c1a64ba04 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 11 14:24:11.649126 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-4f27f03f-3257-4ec9-a6a7-192e95e1eddd tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] Action: 'create', calling method: .version_select at 0x7fba91b60430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1604921611", "metadata": {"Type": "work"}}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:24:11.926847 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-4f27f03f-3257-4ec9-a6a7-192e95e1eddd tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.387451 Jan 11 14:24:11.927803 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 687/1363] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Jan 11 14:24:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 389 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 11 14:24:11.940733 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-59159eb0-fd76-44d2-bc36-39e2aaf9de02 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] Calling method '.version_select at 0x7fba91237af0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:11.992775 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-59159eb0-fd76-44d2-bc36-39e2aaf9de02 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879" status: 200 len: 353 microversion: 2.1 time: 0.056994 Jan 11 14:24:11.993466 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 677/1364] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:24:11 2022] GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:24:13.005499 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9904ea3e-8d45-4098-8b03-d9c796a01f7f tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] Calling method '.version_select at 0x7fba91aa8d30>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:13.052173 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9904ea3e-8d45-4098-8b03-d9c796a01f7f tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879" status: 200 len: 354 microversion: 2.1 time: 0.050760 Jan 11 14:24:13.052741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 688/1365] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:24:13 2022] GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:24:13.064556 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-dbe2330b-9d53-4eef-8121-e9cee3e72d04 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] Calling method '.version_select at 0x7fba91292ca0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:13.111720 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-dbe2330b-9d53-4eef-8121-e9cee3e72d04 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879" status: 200 len: 354 microversion: 2.1 time: 0.051159 Jan 11 14:24:13.112286 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 678/1366] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:24:13 2022] GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:24:13.124090 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-93ab2dd8-c4e9-4e5b-a7fe-8335d7f3b0a2 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] Calling method '.version_select at 0x7fba91aa89d0>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:13.181773 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-93ab2dd8-c4e9-4e5b-a7fe-8335d7f3b0a2 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879" status: 202 len: 0 microversion: 2.1 time: 0.061906 Jan 11 14:24:13.182420 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 689/1367] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Jan 11 14:24:13 2022] DELETE /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:24:13.190794 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-35a545ea-cd03-40d8-bf5e-ad3df8e70887 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] Calling method '.version_select at 0x7fba912929d0>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:13.235598 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-35a545ea-cd03-40d8-bf5e-ad3df8e70887 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879" status: 200 len: 353 microversion: 2.1 time: 0.048347 Jan 11 14:24:13.236184 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 679/1368] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:24:13 2022] GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:24:14.248389 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6eb53693-a42c-42c2-b25c-14cf146ac926 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] Calling method '.version_select at 0x7fba91e25160>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:14.273197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-6eb53693-a42c-42c2-b25c-14cf146ac926 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] HTTP exception thrown: Volume 5ef45e02-f9e1-4ea6-90b5-9fdc06f81879 could not be found. Jan 11 14:24:14.273784 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6eb53693-a42c-42c2-b25c-14cf146ac926 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] Returning 404 to user: Volume 5ef45e02-f9e1-4ea6-90b5-9fdc06f81879 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:14.274589 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6eb53693-a42c-42c2-b25c-14cf146ac926 tempest-VolumesGetTestJSON-929172421 tempest-VolumesGetTestJSON-929172421-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879" status: 404 len: 109 microversion: 2.1 time: 0.031040 Jan 11 14:24:14.275103 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 690/1369] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:24:14 2022] GET /compute/v2.1/os-volumes/5ef45e02-f9e1-4ea6-90b5-9fdc06f81879 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 14:24:15.728109 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7c8f6f42-f79b-4080-aab8-b63f0ce9e612 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Action: 'create', calling method: .version_select at 0x7fba939dc940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2029378085", "metadata": {"Type": "work"}}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:24:15.729536 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7c8f6f42-f79b-4080-aab8-b63f0ce9e612 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:15.730334 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7c8f6f42-f79b-4080-aab8-b63f0ce9e612 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.117729 Jan 11 14:24:15.730863 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 680/1370] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Jan 11 14:24:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:24:15.741142 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cfd4196b-9db7-48d8-a1a5-a808994b1fe2 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Action: 'create', calling method: .version_select at 0x7fba91b799d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1467480519", "metadata": {"Type": "work"}}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:24:15.742496 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-cfd4196b-9db7-48d8-a1a5-a808994b1fe2 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:15.743281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-cfd4196b-9db7-48d8-a1a5-a808994b1fe2 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006754 Jan 11 14:24:15.743822 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 691/1371] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Jan 11 14:24:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:24:15.753658 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5c005f08-ce4b-4cb6-ae5b-fab82b38810e tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Action: 'create', calling method: .version_select at 0x7fba915a1b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-879848071", "metadata": {"Type": "work"}}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:24:15.755611 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-5c005f08-ce4b-4cb6-ae5b-fab82b38810e tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:15.756469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-5c005f08-ce4b-4cb6-ae5b-fab82b38810e tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007112 Jan 11 14:24:15.757010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 681/1372] 10.222.0.49 () {60 vars in 1155 bytes} [Tue Jan 11 14:24:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 14:24:15.768484 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-51749b9a-33f3-46f6-8f51-7af778223298 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Calling method '.version_select at 0x7fba91aa8b80>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:15.793600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-51749b9a-33f3-46f6-8f51-7af778223298 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] HTTP exception thrown: Volume tempest-invalid-535260172 could not be found. Jan 11 14:24:15.794184 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-51749b9a-33f3-46f6-8f51-7af778223298 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Returning 404 to user: Volume tempest-invalid-535260172 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:15.795598 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-51749b9a-33f3-46f6-8f51-7af778223298 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-535260172" status: 404 len: 98 microversion: 2.1 time: 0.031016 Jan 11 14:24:15.796130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 692/1373] 10.222.0.49 () {58 vars in 1214 bytes} [Tue Jan 11 14:24:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-535260172 => generated 98 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 11 14:24:15.805283 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-404c3f67-8a14-4e7c-8b01-deee7c0b551d tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003545 Jan 11 14:24:15.805930 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 682/1374] 10.222.0.49 () {58 vars in 1139 bytes} [Tue Jan 11 14:24:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 11 14:24:15.814981 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-17f97083-531d-4334-9baa-c924dc28463c tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004840 Jan 11 14:24:15.815475 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 693/1375] 10.222.0.49 () {58 vars in 1136 bytes} [Tue Jan 11 14:24:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 11 14:24:15.823355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2c0bbceb-535b-420b-aabc-ebb53ca3e316 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Calling method '.version_select at 0x7fba939dcb80>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:15.855177 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-2c0bbceb-535b-420b-aabc-ebb53ca3e316 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] HTTP exception thrown: Volume 34299cd5-067c-418b-bc5d-5e2827b9671b could not be found. Jan 11 14:24:15.855177 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2c0bbceb-535b-420b-aabc-ebb53ca3e316 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Returning 404 to user: Volume 34299cd5-067c-418b-bc5d-5e2827b9671b could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:15.855177 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2c0bbceb-535b-420b-aabc-ebb53ca3e316 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/34299cd5-067c-418b-bc5d-5e2827b9671b" status: 404 len: 109 microversion: 2.1 time: 0.033978 Jan 11 14:24:15.855177 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 683/1376] 10.222.0.49 () {58 vars in 1247 bytes} [Tue Jan 11 14:24:15 2022] DELETE /compute/v2.1/os-volumes/34299cd5-067c-418b-bc5d-5e2827b9671b => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:24:15.863395 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bd47142b-53eb-4751-b43e-dce190eef4f1 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Calling method '.version_select at 0x7fba939df4c0>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:15.889148 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-bd47142b-53eb-4751-b43e-dce190eef4f1 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] HTTP exception thrown: Volume 40a9090c-faed-4ec7-b49a-457fa263fd5a could not be found. Jan 11 14:24:15.889735 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-bd47142b-53eb-4751-b43e-dce190eef4f1 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] Returning 404 to user: Volume 40a9090c-faed-4ec7-b49a-457fa263fd5a could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:24:15.890551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-bd47142b-53eb-4751-b43e-dce190eef4f1 tempest-VolumesNegativeTest-1084945495 tempest-VolumesNegativeTest-1084945495-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/40a9090c-faed-4ec7-b49a-457fa263fd5a" status: 404 len: 109 microversion: 2.1 time: 0.030812 Jan 11 14:24:15.891089 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 694/1377] 10.222.0.49 () {58 vars in 1244 bytes} [Tue Jan 11 14:24:15 2022] GET /compute/v2.1/os-volumes/40a9090c-faed-4ec7-b49a-457fa263fd5a => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:24:41.679904 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-765869404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1740982666", "security_groups": [{"name": "tempest-secgroup-smoke-1576337113"}], "block_device_mapping_v2": [{"uuid": "d207267f-c132-4150-a90d-d5d607fa19a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bafd8a92-c934-408c-97d9-8c6dc292a947"}]}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:24:41.788440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.network.neutron [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] validate_networks() for [('bafd8a92-c934-408c-97d9-8c6dc292a947', None, None, None, None, None)] {{(pid=116475) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:24:42.470406 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Flavor limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:24:42.470833 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Image limits 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:24:42.471312 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Flavor pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:24:42.471761 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Image pref 0:0:0 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:24:42.472182 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.virt.hardware [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:24:42.480586 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:42.481038 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:42.481856 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:42.482300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:42.498530 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for project 135a305e0bbe4cfcbfea666d19340195. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:24:42.502440 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Getting quotas for user 98f2499d9bdf4026b5f6b310d3e0b21c and project 135a305e0bbe4cfcbfea666d19340195. Resources: {'ram', 'cores', 'instances'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:24:42.557118 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Going to run 1 instances... {{(pid=116475) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:24:42.559259 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d207267f-c132-4150-a90d-d5d607fa19a2',volume_size=None,volume_type=None)] {{(pid=116475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:24:42.678442 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-cc456080-8c03-4a7e-adb6-86c30cb8fa83 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.002734 Jan 11 14:24:42.679077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 684/1378] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:24:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:24:42.689382 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e3eea686-bf56-41a2-bac1-2866a1e7e03f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:42.689997 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e3eea686-bf56-41a2-bac1-2866a1e7e03f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:42.740801 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e3eea686-bf56-41a2-bac1-2866a1e7e03f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:42.747115 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e3eea686-bf56-41a2-bac1-2866a1e7e03f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1094 microversion: 2.1 time: 0.062040 Jan 11 14:24:42.747702 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 695/1379] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:42 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:43.764307 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ce097702-6ce5-4ff1-96df-d06cf7931b49 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:43.764850 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ce097702-6ce5-4ff1-96df-d06cf7931b49 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:43.770871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ce097702-6ce5-4ff1-96df-d06cf7931b49 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:43.771325 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ce097702-6ce5-4ff1-96df-d06cf7931b49 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:43.772148 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ce097702-6ce5-4ff1-96df-d06cf7931b49 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:43.772589 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ce097702-6ce5-4ff1-96df-d06cf7931b49 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:43.832347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ce097702-6ce5-4ff1-96df-d06cf7931b49 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:43.839517 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ce097702-6ce5-4ff1-96df-d06cf7931b49 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1144 microversion: 2.1 time: 0.079704 Jan 11 14:24:43.840081 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 685/1380] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:43 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:44.856320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-c8b20800-137c-4888-8bb3-d0a1dcb3aaa8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:44.856930 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-c8b20800-137c-4888-8bb3-d0a1dcb3aaa8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:44.863832 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8b20800-137c-4888-8bb3-d0a1dcb3aaa8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:44.864459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8b20800-137c-4888-8bb3-d0a1dcb3aaa8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:44.865066 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8b20800-137c-4888-8bb3-d0a1dcb3aaa8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:44.865501 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-c8b20800-137c-4888-8bb3-d0a1dcb3aaa8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:44.925340 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-c8b20800-137c-4888-8bb3-d0a1dcb3aaa8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:44.934140 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-c8b20800-137c-4888-8bb3-d0a1dcb3aaa8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1200 microversion: 2.1 time: 0.081383 Jan 11 14:24:44.934713 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 696/1381] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:44 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1200 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:24:45.951782 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b1d1d5f7-f2ad-4034-ac45-8bdcab041bd3 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:45.953142 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b1d1d5f7-f2ad-4034-ac45-8bdcab041bd3 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:45.959459 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b1d1d5f7-f2ad-4034-ac45-8bdcab041bd3 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:45.959953 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b1d1d5f7-f2ad-4034-ac45-8bdcab041bd3 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:45.960744 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b1d1d5f7-f2ad-4034-ac45-8bdcab041bd3 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:45.961186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b1d1d5f7-f2ad-4034-ac45-8bdcab041bd3 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:46.096808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b1d1d5f7-f2ad-4034-ac45-8bdcab041bd3 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:46.104137 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b1d1d5f7-f2ad-4034-ac45-8bdcab041bd3 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1278 microversion: 2.1 time: 0.156445 Jan 11 14:24:46.106045 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 686/1382] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:45 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:46.703610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-1f8716d3-b9e8-45ef-ad2d-39f600ef7254 req-81b1f13c-faf5-4664-aa30-057eb35cbfd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e808871-d76c-4ed2-8cac-bf9d1732ec3a", "tag": "5599536b-3bf6-4ae9-a675-b0498bc7116e"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:24:46.703610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:24:46.703610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:24:46.720135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-1f8716d3-b9e8-45ef-ad2d-39f600ef7254 req-81b1f13c-faf5-4664-aa30-057eb35cbfd1 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:46.720942 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-1f8716d3-b9e8-45ef-ad2d-39f600ef7254 req-81b1f13c-faf5-4664-aa30-057eb35cbfd1 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:46.739769 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-1f8716d3-b9e8-45ef-ad2d-39f600ef7254 req-81b1f13c-faf5-4664-aa30-057eb35cbfd1 service nova] Creating event network-changed:5599536b-3bf6-4ae9-a675-b0498bc7116e for instance 9e808871-d76c-4ed2-8cac-bf9d1732ec3a on hv-cinder-82413 Jan 11 14:24:46.746102 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-1f8716d3-b9e8-45ef-ad2d-39f600ef7254 req-81b1f13c-faf5-4664-aa30-057eb35cbfd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268938 Jan 11 14:24:46.747292 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 697/1383] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:24:47.120378 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e0ec8330-31ba-4bcb-bdc6-1397d72f980b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:47.120920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e0ec8330-31ba-4bcb-bdc6-1397d72f980b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:47.127383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e0ec8330-31ba-4bcb-bdc6-1397d72f980b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:47.127872 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e0ec8330-31ba-4bcb-bdc6-1397d72f980b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:47.128670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e0ec8330-31ba-4bcb-bdc6-1397d72f980b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:47.129107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e0ec8330-31ba-4bcb-bdc6-1397d72f980b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:47.268174 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e0ec8330-31ba-4bcb-bdc6-1397d72f980b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:47.276479 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e0ec8330-31ba-4bcb-bdc6-1397d72f980b tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.159860 Jan 11 14:24:47.277045 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 687/1384] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:47 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:48.294611 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-b66eda82-1c10-4912-bf57-e6a26a8d407e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:48.295467 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-b66eda82-1c10-4912-bf57-e6a26a8d407e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:48.302997 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b66eda82-1c10-4912-bf57-e6a26a8d407e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:48.303473 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b66eda82-1c10-4912-bf57-e6a26a8d407e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:48.304271 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b66eda82-1c10-4912-bf57-e6a26a8d407e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:48.304701 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-b66eda82-1c10-4912-bf57-e6a26a8d407e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:48.434349 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-b66eda82-1c10-4912-bf57-e6a26a8d407e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:48.441671 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-b66eda82-1c10-4912-bf57-e6a26a8d407e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.151258 Jan 11 14:24:48.442232 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 698/1385] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:48 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:49.458173 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-2b28e538-4ac3-4dde-a976-0e48201c85fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:49.458846 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-2b28e538-4ac3-4dde-a976-0e48201c85fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:49.470815 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2b28e538-4ac3-4dde-a976-0e48201c85fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:49.472324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2b28e538-4ac3-4dde-a976-0e48201c85fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:49.473811 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2b28e538-4ac3-4dde-a976-0e48201c85fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:49.474343 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-2b28e538-4ac3-4dde-a976-0e48201c85fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:49.636500 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-2b28e538-4ac3-4dde-a976-0e48201c85fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:49.644529 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-2b28e538-4ac3-4dde-a976-0e48201c85fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.190114 Jan 11 14:24:49.653877 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 688/1386] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:49 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:50.661454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8864ef93-a1fc-43e6-b9a5-7ca5fbe7936a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:50.662180 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8864ef93-a1fc-43e6-b9a5-7ca5fbe7936a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:50.669584 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8864ef93-a1fc-43e6-b9a5-7ca5fbe7936a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:50.670150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8864ef93-a1fc-43e6-b9a5-7ca5fbe7936a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:50.671109 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8864ef93-a1fc-43e6-b9a5-7ca5fbe7936a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:50.671706 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8864ef93-a1fc-43e6-b9a5-7ca5fbe7936a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:50.828417 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8864ef93-a1fc-43e6-b9a5-7ca5fbe7936a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:50.836224 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8864ef93-a1fc-43e6-b9a5-7ca5fbe7936a tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.178493 Jan 11 14:24:50.837321 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 699/1387] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:50 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:51.853924 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e45910d4-a9ab-49b0-acfe-6636978d3d63 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:51.855016 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e45910d4-a9ab-49b0-acfe-6636978d3d63 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:51.865110 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e45910d4-a9ab-49b0-acfe-6636978d3d63 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:51.866212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e45910d4-a9ab-49b0-acfe-6636978d3d63 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:51.867791 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e45910d4-a9ab-49b0-acfe-6636978d3d63 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:51.868849 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e45910d4-a9ab-49b0-acfe-6636978d3d63 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:52.057812 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e45910d4-a9ab-49b0-acfe-6636978d3d63 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:52.068402 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e45910d4-a9ab-49b0-acfe-6636978d3d63 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.218630 Jan 11 14:24:52.069800 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 689/1388] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:51 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:53.088034 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-464278ce-f1f9-4ac7-b1e4-4ec5c5df86ed tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:53.089200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-464278ce-f1f9-4ac7-b1e4-4ec5c5df86ed tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:53.097692 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-464278ce-f1f9-4ac7-b1e4-4ec5c5df86ed tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:53.098090 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-464278ce-f1f9-4ac7-b1e4-4ec5c5df86ed tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:53.099072 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-464278ce-f1f9-4ac7-b1e4-4ec5c5df86ed tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:53.099531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-464278ce-f1f9-4ac7-b1e4-4ec5c5df86ed tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:53.288960 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-464278ce-f1f9-4ac7-b1e4-4ec5c5df86ed tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:53.299590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-464278ce-f1f9-4ac7-b1e4-4ec5c5df86ed tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.214797 Jan 11 14:24:53.301052 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 700/1389] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:53 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:54.316473 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-23d6c489-6e87-44c6-8ba5-762dc62ba151 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:54.317096 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-23d6c489-6e87-44c6-8ba5-762dc62ba151 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:54.324300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-23d6c489-6e87-44c6-8ba5-762dc62ba151 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:54.324756 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-23d6c489-6e87-44c6-8ba5-762dc62ba151 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:54.325560 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-23d6c489-6e87-44c6-8ba5-762dc62ba151 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:54.326000 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-23d6c489-6e87-44c6-8ba5-762dc62ba151 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:54.494458 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-23d6c489-6e87-44c6-8ba5-762dc62ba151 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:54.503909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-23d6c489-6e87-44c6-8ba5-762dc62ba151 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.190979 Jan 11 14:24:54.504603 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 690/1390] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:54 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:55.520941 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6446ebfd-ce9b-4a1f-bb5f-b58f302299fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:55.521560 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6446ebfd-ce9b-4a1f-bb5f-b58f302299fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:55.529631 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6446ebfd-ce9b-4a1f-bb5f-b58f302299fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:55.530135 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6446ebfd-ce9b-4a1f-bb5f-b58f302299fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:55.531166 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6446ebfd-ce9b-4a1f-bb5f-b58f302299fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:55.531638 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6446ebfd-ce9b-4a1f-bb5f-b58f302299fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:55.839734 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6446ebfd-ce9b-4a1f-bb5f-b58f302299fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:55.847825 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6446ebfd-ce9b-4a1f-bb5f-b58f302299fe tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.330520 Jan 11 14:24:55.850654 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 701/1391] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:55 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:56.866424 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b7b0efe6-a14b-4ed9-aa08-9b5c7301f875 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:56.867769 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b7b0efe6-a14b-4ed9-aa08-9b5c7301f875 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:56.883202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7b0efe6-a14b-4ed9-aa08-9b5c7301f875 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:56.883949 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7b0efe6-a14b-4ed9-aa08-9b5c7301f875 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:56.885116 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7b0efe6-a14b-4ed9-aa08-9b5c7301f875 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:56.885947 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7b0efe6-a14b-4ed9-aa08-9b5c7301f875 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:57.183244 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b7b0efe6-a14b-4ed9-aa08-9b5c7301f875 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:57.195487 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b7b0efe6-a14b-4ed9-aa08-9b5c7301f875 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.332552 Jan 11 14:24:57.196735 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 691/1392] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:56 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:58.214101 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f71e710e-f909-48a5-9b21-52696109eb55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:58.216300 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f71e710e-f909-48a5-9b21-52696109eb55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:58.225190 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f71e710e-f909-48a5-9b21-52696109eb55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:58.226192 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f71e710e-f909-48a5-9b21-52696109eb55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:58.227190 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f71e710e-f909-48a5-9b21-52696109eb55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:58.228002 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f71e710e-f909-48a5-9b21-52696109eb55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:58.492897 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f71e710e-f909-48a5-9b21-52696109eb55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:58.502386 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f71e710e-f909-48a5-9b21-52696109eb55 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.291811 Jan 11 14:24:58.503543 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 702/1393] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:58 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:24:59.523374 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-96c1b677-f937-46ee-8e07-04ea603e0b71 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:24:59.523920 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-96c1b677-f937-46ee-8e07-04ea603e0b71 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:24:59.534430 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-96c1b677-f937-46ee-8e07-04ea603e0b71 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:59.536126 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-96c1b677-f937-46ee-8e07-04ea603e0b71 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:59.544253 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-96c1b677-f937-46ee-8e07-04ea603e0b71 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:59.544750 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-96c1b677-f937-46ee-8e07-04ea603e0b71 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:59.764737 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-76044983-64d2-4d59-aa2f-8904cbfaf496 req-2dd5a955-7ef5-4ba7-979a-c385a32f3f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e808871-d76c-4ed2-8cac-bf9d1732ec3a", "name": "network-vif-plugged", "status": "completed", "tag": "5599536b-3bf6-4ae9-a675-b0498bc7116e"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:24:59.769744 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:24:59.769744 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:24:59.798134 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-76044983-64d2-4d59-aa2f-8904cbfaf496 req-2dd5a955-7ef5-4ba7-979a-c385a32f3f4f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:24:59.801495 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-76044983-64d2-4d59-aa2f-8904cbfaf496 req-2dd5a955-7ef5-4ba7-979a-c385a32f3f4f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:24:59.841350 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-76044983-64d2-4d59-aa2f-8904cbfaf496 req-2dd5a955-7ef5-4ba7-979a-c385a32f3f4f service nova] Creating event network-vif-plugged:5599536b-3bf6-4ae9-a675-b0498bc7116e for instance 9e808871-d76c-4ed2-8cac-bf9d1732ec3a on hv-cinder-82413 Jan 11 14:24:59.855476 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-76044983-64d2-4d59-aa2f-8904cbfaf496 req-2dd5a955-7ef5-4ba7-979a-c385a32f3f4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264109 Jan 11 14:24:59.857528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 703/1394] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:24:59.911355 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-96c1b677-f937-46ee-8e07-04ea603e0b71 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:24:59.920745 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-96c1b677-f937-46ee-8e07-04ea603e0b71 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.400926 Jan 11 14:24:59.922595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 692/1395] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:24:59 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:00.939847 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-db0a0f14-4f54-4867-a701-787909b8a3da tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:00.941151 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-db0a0f14-4f54-4867-a701-787909b8a3da tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:00.951194 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db0a0f14-4f54-4867-a701-787909b8a3da tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:00.951910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db0a0f14-4f54-4867-a701-787909b8a3da tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:00.955279 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db0a0f14-4f54-4867-a701-787909b8a3da tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:00.960828 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-db0a0f14-4f54-4867-a701-787909b8a3da tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:01.342131 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-17c4dc86-47bf-47ba-8fd8-a7a89b89efa5 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Action: 'create', calling method: .version_select at 0x7fba913a0b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1394274626"}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:01.344225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-db0a0f14-4f54-4867-a701-787909b8a3da tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:01.360012 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-db0a0f14-4f54-4867-a701-787909b8a3da tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1266 microversion: 2.1 time: 0.425316 Jan 11 14:25:01.361599 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-17c4dc86-47bf-47ba-8fd8-a7a89b89efa5 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Getting quotas for project 802231c203874b75b82b8b9358e6f61d. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:25:01.369212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-17c4dc86-47bf-47ba-8fd8-a7a89b89efa5 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Getting quotas for user da4f33e6ff574fcebecd104a8a5aa623 and project 802231c203874b75b82b8b9358e6f61d. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:25:01.375913 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 704/1396] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:00 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1266 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:01.581076 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-17c4dc86-47bf-47ba-8fd8-a7a89b89efa5 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Getting quotas for project 802231c203874b75b82b8b9358e6f61d. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:25:01.597709 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.quota [None req-17c4dc86-47bf-47ba-8fd8-a7a89b89efa5 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Getting quotas for user da4f33e6ff574fcebecd104a8a5aa623 and project 802231c203874b75b82b8b9358e6f61d. Resources: {'key_pairs'} {{(pid=116475) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:25:01.623557 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-17c4dc86-47bf-47ba-8fd8-a7a89b89efa5 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.642625 Jan 11 14:25:01.625780 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 693/1397] 10.222.0.49 () {60 vars in 1157 bytes} [Tue Jan 11 14:25:00 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:25:02.381940 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9c8f8c37-4091-4e24-a531-00801e1e1102 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:02.384347 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9c8f8c37-4091-4e24-a531-00801e1e1102 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:02.392122 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9c8f8c37-4091-4e24-a531-00801e1e1102 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:02.392599 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9c8f8c37-4091-4e24-a531-00801e1e1102 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:02.393434 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9c8f8c37-4091-4e24-a531-00801e1e1102 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:02.394060 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9c8f8c37-4091-4e24-a531-00801e1e1102 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:02.568106 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9c8f8c37-4091-4e24-a531-00801e1e1102 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:02.579928 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9c8f8c37-4091-4e24-a531-00801e1e1102 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1454 microversion: 2.1 time: 0.201498 Jan 11 14:25:02.580843 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 705/1398] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:02 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1454 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:02.601533 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-110843b4-bfc9-4241-960e-07d1f4a2fca8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:02.603003 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-110843b4-bfc9-4241-960e-07d1f4a2fca8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:02.611834 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-110843b4-bfc9-4241-960e-07d1f4a2fca8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:02.612443 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-110843b4-bfc9-4241-960e-07d1f4a2fca8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:02.620956 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-110843b4-bfc9-4241-960e-07d1f4a2fca8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:02.622089 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-110843b4-bfc9-4241-960e-07d1f4a2fca8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:02.863268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-110843b4-bfc9-4241-960e-07d1f4a2fca8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:02.871706 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-110843b4-bfc9-4241-960e-07d1f4a2fca8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1454 microversion: 2.1 time: 0.279271 Jan 11 14:25:02.872277 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 694/1399] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:02 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1454 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:03.963130 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-26316404", "imageRef": "f3b4e192-58e8-4fa3-a997-2a3187e9816d", "flavorRef": "452"}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:04.016996 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] validate_networks() for None {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:25:04.340005 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:25:04.340975 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:25:04.341651 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:25:04.342132 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:25:04.343241 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:25:04.358999 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:04.359459 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:04.360302 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:04.360739 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:04.382492 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Getting quotas for project 2cd259049fb14ea6a452bd0d2eb32dd2. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:25:04.402550 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Getting quotas for user 42ab9f15fb7a4282910ec36911ba3e7f and project 2cd259049fb14ea6a452bd0d2eb32dd2. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:25:04.428039 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:25:04.433041 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3b4e192-58e8-4fa3-a997-2a3187e9816d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:25:04.522531 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-02d4fcdb-0728-448d-9a56-143ee9581112 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562742 Jan 11 14:25:04.523206 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 706/1400] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:25:04.538324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9724cc1a-d6f9-41c7-985f-b638e46d84e6 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:04.544622 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9724cc1a-d6f9-41c7-985f-b638e46d84e6 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:04.629934 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9724cc1a-d6f9-41c7-985f-b638e46d84e6 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:04.637278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9724cc1a-d6f9-41c7-985f-b638e46d84e6 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1213 microversion: 2.1 time: 0.103015 Jan 11 14:25:04.638929 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 695/1401] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:04 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:05.142895 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-a4bdd1c9-d910-42d0-b927-0b25f26783be req-c3d65cbb-9c69-4c62-bd4e-cf1bca2150cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e808871-d76c-4ed2-8cac-bf9d1732ec3a", "tag": "5599536b-3bf6-4ae9-a675-b0498bc7116e"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:05.144858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:25:05.144858 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:25:05.153660 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-a4bdd1c9-d910-42d0-b927-0b25f26783be req-c3d65cbb-9c69-4c62-bd4e-cf1bca2150cf service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:05.154328 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-a4bdd1c9-d910-42d0-b927-0b25f26783be req-c3d65cbb-9c69-4c62-bd4e-cf1bca2150cf service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:05.167007 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-a4bdd1c9-d910-42d0-b927-0b25f26783be req-c3d65cbb-9c69-4c62-bd4e-cf1bca2150cf service nova] Creating event network-changed:5599536b-3bf6-4ae9-a675-b0498bc7116e for instance 9e808871-d76c-4ed2-8cac-bf9d1732ec3a on hv-cinder-82413 Jan 11 14:25:05.178867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-a4bdd1c9-d910-42d0-b927-0b25f26783be req-c3d65cbb-9c69-4c62-bd4e-cf1bca2150cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039717 Jan 11 14:25:05.179879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 707/1402] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:25:05.655747 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-450e188a-a5c1-446e-b79f-32f8456fa980 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:05.656364 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-450e188a-a5c1-446e-b79f-32f8456fa980 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:05.665597 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-450e188a-a5c1-446e-b79f-32f8456fa980 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:05.668127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-450e188a-a5c1-446e-b79f-32f8456fa980 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:05.669306 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-450e188a-a5c1-446e-b79f-32f8456fa980 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:05.670011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-450e188a-a5c1-446e-b79f-32f8456fa980 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:05.750595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-450e188a-a5c1-446e-b79f-32f8456fa980 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:05.761218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-450e188a-a5c1-446e-b79f-32f8456fa980 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1265 microversion: 2.1 time: 0.106744 Jan 11 14:25:05.762096 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 696/1403] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:05 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:06.778869 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a5827d7e-6c08-412c-976c-3a4ddfebf71c tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:06.779603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a5827d7e-6c08-412c-976c-3a4ddfebf71c tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:06.786509 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a5827d7e-6c08-412c-976c-3a4ddfebf71c tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:06.787025 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a5827d7e-6c08-412c-976c-3a4ddfebf71c tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:06.788053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a5827d7e-6c08-412c-976c-3a4ddfebf71c tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:06.788807 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a5827d7e-6c08-412c-976c-3a4ddfebf71c tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:07.066095 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a5827d7e-6c08-412c-976c-3a4ddfebf71c tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:07.073200 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a5827d7e-6c08-412c-976c-3a4ddfebf71c tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.298586 Jan 11 14:25:07.074082 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 708/1404] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:06 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:07.597186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-661789a5-b57f-4e81-ad46-5d9f5c9e805d req-12f1b1cd-6dae-467a-bac4-0104960d1735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06f6adc-eae1-40b5-a84c-5d717fa9fdb1", "tag": "42b7fbb5-5d7e-40b3-a377-811a222ec62f"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:07.599260 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:25:07.599260 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:25:07.613243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-661789a5-b57f-4e81-ad46-5d9f5c9e805d req-12f1b1cd-6dae-467a-bac4-0104960d1735 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:07.613699 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-661789a5-b57f-4e81-ad46-5d9f5c9e805d req-12f1b1cd-6dae-467a-bac4-0104960d1735 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:07.640166 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-661789a5-b57f-4e81-ad46-5d9f5c9e805d req-12f1b1cd-6dae-467a-bac4-0104960d1735 service nova] Creating event network-changed:42b7fbb5-5d7e-40b3-a377-811a222ec62f for instance b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 on hv-cinder-82413 Jan 11 14:25:07.645397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-661789a5-b57f-4e81-ad46-5d9f5c9e805d req-12f1b1cd-6dae-467a-bac4-0104960d1735 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194119 Jan 11 14:25:07.646881 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 697/1405] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:25:08.089481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-037ba464-2726-4768-b98a-bec1c5f2c355 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:08.090094 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-037ba464-2726-4768-b98a-bec1c5f2c355 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:08.096972 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-037ba464-2726-4768-b98a-bec1c5f2c355 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:08.097445 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-037ba464-2726-4768-b98a-bec1c5f2c355 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:08.098222 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-037ba464-2726-4768-b98a-bec1c5f2c355 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:08.098655 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-037ba464-2726-4768-b98a-bec1c5f2c355 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:08.285210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-037ba464-2726-4768-b98a-bec1c5f2c355 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:08.293479 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-037ba464-2726-4768-b98a-bec1c5f2c355 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.207615 Jan 11 14:25:08.294161 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 709/1406] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:08 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:09.311570 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-945cbe78-e5e7-4856-99b6-de65915a91aa tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:09.312301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-945cbe78-e5e7-4856-99b6-de65915a91aa tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:09.319200 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-945cbe78-e5e7-4856-99b6-de65915a91aa tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:09.320134 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-945cbe78-e5e7-4856-99b6-de65915a91aa tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:09.321574 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-945cbe78-e5e7-4856-99b6-de65915a91aa tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:09.322106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-945cbe78-e5e7-4856-99b6-de65915a91aa tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:09.462054 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-945cbe78-e5e7-4856-99b6-de65915a91aa tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:09.469981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-945cbe78-e5e7-4856-99b6-de65915a91aa tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.163395 Jan 11 14:25:09.470600 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 698/1407] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:09 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:10.486976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-8d515fae-97e7-4512-aa37-873613bf350a tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:10.487614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-8d515fae-97e7-4512-aa37-873613bf350a tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:10.493932 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d515fae-97e7-4512-aa37-873613bf350a tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:10.494376 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d515fae-97e7-4512-aa37-873613bf350a tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:10.495158 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d515fae-97e7-4512-aa37-873613bf350a tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:10.495617 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-8d515fae-97e7-4512-aa37-873613bf350a tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:10.631192 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-8d515fae-97e7-4512-aa37-873613bf350a tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:10.638591 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-8d515fae-97e7-4512-aa37-873613bf350a tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.155876 Jan 11 14:25:10.639147 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 710/1408] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:10 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:11.655186 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3f927a75-7425-4ba3-b40c-e5f1c74d24f0 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:11.655843 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3f927a75-7425-4ba3-b40c-e5f1c74d24f0 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:11.662216 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3f927a75-7425-4ba3-b40c-e5f1c74d24f0 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:11.662673 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3f927a75-7425-4ba3-b40c-e5f1c74d24f0 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:11.663485 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3f927a75-7425-4ba3-b40c-e5f1c74d24f0 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:11.664028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3f927a75-7425-4ba3-b40c-e5f1c74d24f0 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:11.796713 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3f927a75-7425-4ba3-b40c-e5f1c74d24f0 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:11.804774 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3f927a75-7425-4ba3-b40c-e5f1c74d24f0 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.153201 Jan 11 14:25:11.806134 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 699/1409] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:11 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:12.821910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ae0bf627-3f0e-40f9-9c20-c02f5f9081c1 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:12.822524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ae0bf627-3f0e-40f9-9c20-c02f5f9081c1 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:12.829120 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae0bf627-3f0e-40f9-9c20-c02f5f9081c1 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:12.829580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae0bf627-3f0e-40f9-9c20-c02f5f9081c1 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:12.830368 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae0bf627-3f0e-40f9-9c20-c02f5f9081c1 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:12.830809 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ae0bf627-3f0e-40f9-9c20-c02f5f9081c1 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:12.964946 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-ae0bf627-3f0e-40f9-9c20-c02f5f9081c1 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:12.972890 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ae0bf627-3f0e-40f9-9c20-c02f5f9081c1 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.154537 Jan 11 14:25:12.973484 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 711/1410] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:12 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:13.989325 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-014a2ba7-354b-4f3d-bd2b-4e498ddaae21 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:13.989925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-014a2ba7-354b-4f3d-bd2b-4e498ddaae21 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:13.996814 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-014a2ba7-354b-4f3d-bd2b-4e498ddaae21 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:13.997258 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-014a2ba7-354b-4f3d-bd2b-4e498ddaae21 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:13.998027 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-014a2ba7-354b-4f3d-bd2b-4e498ddaae21 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:13.998457 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-014a2ba7-354b-4f3d-bd2b-4e498ddaae21 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:14.129539 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-014a2ba7-354b-4f3d-bd2b-4e498ddaae21 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:14.136668 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-014a2ba7-354b-4f3d-bd2b-4e498ddaae21 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.150952 Jan 11 14:25:14.137231 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 700/1411] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:13 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:14.924474 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-b61f57d9-e5d6-4592-a829-e097f306ebd0 req-d2c4a0d9-92a9-453a-9bdc-e5c3c0c7526f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06f6adc-eae1-40b5-a84c-5d717fa9fdb1", "name": "network-vif-plugged", "status": "completed", "tag": "42b7fbb5-5d7e-40b3-a377-811a222ec62f"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:14.926482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:25:14.926482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:25:14.937069 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b61f57d9-e5d6-4592-a829-e097f306ebd0 req-d2c4a0d9-92a9-453a-9bdc-e5c3c0c7526f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:14.937524 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-b61f57d9-e5d6-4592-a829-e097f306ebd0 req-d2c4a0d9-92a9-453a-9bdc-e5c3c0c7526f service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:14.949272 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-b61f57d9-e5d6-4592-a829-e097f306ebd0 req-d2c4a0d9-92a9-453a-9bdc-e5c3c0c7526f service nova] Creating event network-vif-plugged:42b7fbb5-5d7e-40b3-a377-811a222ec62f for instance b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 on hv-cinder-82413 Jan 11 14:25:14.954776 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-b61f57d9-e5d6-4592-a829-e097f306ebd0 req-d2c4a0d9-92a9-453a-9bdc-e5c3c0c7526f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034802 Jan 11 14:25:14.955664 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 712/1412] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:25:15.153665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-3e8cb7f7-917d-47e7-b975-77320e38f51d tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:15.154310 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-3e8cb7f7-917d-47e7-b975-77320e38f51d tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:15.161433 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3e8cb7f7-917d-47e7-b975-77320e38f51d tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:15.161885 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3e8cb7f7-917d-47e7-b975-77320e38f51d tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:15.162678 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3e8cb7f7-917d-47e7-b975-77320e38f51d tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:15.163116 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-3e8cb7f7-917d-47e7-b975-77320e38f51d tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:15.292872 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-3e8cb7f7-917d-47e7-b975-77320e38f51d tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:15.300672 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-3e8cb7f7-917d-47e7-b975-77320e38f51d tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.150793 Jan 11 14:25:15.301233 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 701/1413] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:15 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:16.318603 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9f608424-fe49-40fd-8654-f42e94691ccb tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:16.319225 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9f608424-fe49-40fd-8654-f42e94691ccb tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:16.325985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f608424-fe49-40fd-8654-f42e94691ccb tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:16.326435 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f608424-fe49-40fd-8654-f42e94691ccb tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:16.327249 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f608424-fe49-40fd-8654-f42e94691ccb tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:16.327719 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f608424-fe49-40fd-8654-f42e94691ccb tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:16.455318 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9f608424-fe49-40fd-8654-f42e94691ccb tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:16.462707 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9f608424-fe49-40fd-8654-f42e94691ccb tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1313 microversion: 2.1 time: 0.148251 Jan 11 14:25:16.463268 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 713/1414] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:16 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:17.479670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-8d7b1e16-d192-4018-924e-d10b1ff4cb80 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:17.480279 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-8d7b1e16-d192-4018-924e-d10b1ff4cb80 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:17.487101 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8d7b1e16-d192-4018-924e-d10b1ff4cb80 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:17.487638 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8d7b1e16-d192-4018-924e-d10b1ff4cb80 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:17.488428 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8d7b1e16-d192-4018-924e-d10b1ff4cb80 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:17.488845 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-8d7b1e16-d192-4018-924e-d10b1ff4cb80 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:17.613433 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-8d7b1e16-d192-4018-924e-d10b1ff4cb80 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:17.620891 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-8d7b1e16-d192-4018-924e-d10b1ff4cb80 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1462 microversion: 2.1 time: 0.144841 Jan 11 14:25:17.621463 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 702/1415] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:17 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1462 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:17.656649 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-1e4922e3-3383-492e-8da9-4d60a1f74e91 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:17.657199 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1e4922e3-3383-492e-8da9-4d60a1f74e91 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:17.663378 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1e4922e3-3383-492e-8da9-4d60a1f74e91 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:17.663853 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1e4922e3-3383-492e-8da9-4d60a1f74e91 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:17.664624 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1e4922e3-3383-492e-8da9-4d60a1f74e91 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:17.665052 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-1e4922e3-3383-492e-8da9-4d60a1f74e91 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:17.689394 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-1e4922e3-3383-492e-8da9-4d60a1f74e91 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:25:17.759546 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-1e4922e3-3383-492e-8da9-4d60a1f74e91 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 204 len: 0 microversion: 2.1 time: 0.106709 Jan 11 14:25:17.760033 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 714/1416] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:25:17 2022] DELETE /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:25:17.769757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-669b52e7-3f77-4807-8b16-1047d19d7c24 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:17.770365 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-669b52e7-3f77-4807-8b16-1047d19d7c24 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:17.776195 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-669b52e7-3f77-4807-8b16-1047d19d7c24 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:17.776640 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-669b52e7-3f77-4807-8b16-1047d19d7c24 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:17.777409 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-669b52e7-3f77-4807-8b16-1047d19d7c24 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:17.777862 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-669b52e7-3f77-4807-8b16-1047d19d7c24 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:17.909338 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-669b52e7-3f77-4807-8b16-1047d19d7c24 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:17.916579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-669b52e7-3f77-4807-8b16-1047d19d7c24 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1468 microversion: 2.1 time: 0.150824 Jan 11 14:25:17.917174 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 703/1417] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:17 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:18.934761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a4273256-1a4e-435a-8984-8c67447e14a5 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:18.935626 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a4273256-1a4e-435a-8984-8c67447e14a5 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:18.941905 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a4273256-1a4e-435a-8984-8c67447e14a5 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:18.942347 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a4273256-1a4e-435a-8984-8c67447e14a5 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:18.943111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a4273256-1a4e-435a-8984-8c67447e14a5 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:18.943577 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a4273256-1a4e-435a-8984-8c67447e14a5 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:19.076075 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a4273256-1a4e-435a-8984-8c67447e14a5 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:19.083281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a4273256-1a4e-435a-8984-8c67447e14a5 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1468 microversion: 2.1 time: 0.152887 Jan 11 14:25:19.083879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 715/1418] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:18 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:20.101031 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e3792c69-9db4-457d-820f-b81cad7475de tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:20.101646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e3792c69-9db4-457d-820f-b81cad7475de tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:20.111754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e3792c69-9db4-457d-820f-b81cad7475de tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:20.112262 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e3792c69-9db4-457d-820f-b81cad7475de tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:20.113059 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e3792c69-9db4-457d-820f-b81cad7475de tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:20.114068 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e3792c69-9db4-457d-820f-b81cad7475de tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:20.152359 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-44af4162-aa86-472e-85de-7313d1fdb8bd req-3e45a953-32f1-434e-a840-3ffecad5857e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06f6adc-eae1-40b5-a84c-5d717fa9fdb1", "name": "network-vif-deleted", "tag": "42b7fbb5-5d7e-40b3-a377-811a222ec62f"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:20.153882 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:25:20.153882 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:25:20.161367 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-44af4162-aa86-472e-85de-7313d1fdb8bd req-3e45a953-32f1-434e-a840-3ffecad5857e service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:20.161816 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-44af4162-aa86-472e-85de-7313d1fdb8bd req-3e45a953-32f1-434e-a840-3ffecad5857e service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:20.187388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e3792c69-9db4-457d-820f-b81cad7475de tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ab9f15fb7a4282910ec36911ba3e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cd259049fb14ea6a452bd0d2eb32dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:20.190461 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-44af4162-aa86-472e-85de-7313d1fdb8bd req-3e45a953-32f1-434e-a840-3ffecad5857e service nova] Creating event network-vif-deleted:42b7fbb5-5d7e-40b3-a377-811a222ec62f for instance b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 on hv-cinder-82413 Jan 11 14:25:20.197397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e3792c69-9db4-457d-820f-b81cad7475de tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 200 len: 1426 microversion: 2.1 time: 0.100047 Jan 11 14:25:20.200438 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 704/1419] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:20 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 1426 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:20.210704 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-44af4162-aa86-472e-85de-7313d1fdb8bd req-3e45a953-32f1-434e-a840-3ffecad5857e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051618 Jan 11 14:25:20.211752 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 716/1420] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:25:21.217875 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:21.218490 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] [instance: b06f6adc-eae1-40b5-a84c-5d717fa9fdb1] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:21.224689 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:21.225132 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:21.225902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:21.226333 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:21.239377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] HTTP exception thrown: Instance b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 could not be found. Jan 11 14:25:21.239944 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] Returning 404 to user: Instance b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:25:21.240757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-459568d5-8858-4f02-ac1b-7db82335a638 tempest-VolumesNegativeTest-483727088 tempest-VolumesNegativeTest-483727088-project] 10.222.0.49 "GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1" status: 404 len: 111 microversion: 2.1 time: 0.026654 Jan 11 14:25:21.241283 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 705/1421] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:21 2022] GET /compute/v2.1/servers/b06f6adc-eae1-40b5-a84c-5d717fa9fdb1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:25:24.437409 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-886900054", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1394274626", "security_groups": [{"name": "tempest-secgroup-smoke-416831377"}], "networks": [{"uuid": "449b9fd4-a429-4fad-859d-a2586ac97009"}], "block_device_mapping_v2": [{"uuid": "97e2c234-0b4e-4a25-b6fa-8da767d80234", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:24.545142 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.network.neutron [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] validate_networks() for [('449b9fd4-a429-4fad-859d-a2586ac97009', None, None, None, None, None)] {{(pid=116474) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 14:25:24.970546 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Flavor limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 14:25:24.971003 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Image limits 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 14:25:24.971479 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Flavor pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 14:25:24.971943 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Image pref 0:0:0 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 14:25:24.972387 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.virt.hardware [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 14:25:24.980884 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:24.981313 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:24.982140 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:24.982570 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:24.998938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Getting quotas for project 802231c203874b75b82b8b9358e6f61d. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 14:25:25.002849 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.quota [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Getting quotas for user da4f33e6ff574fcebecd104a8a5aa623 and project 802231c203874b75b82b8b9358e6f61d. Resources: {'ram', 'cores', 'instances'} {{(pid=116474) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 14:25:25.058143 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Going to run 1 instances... {{(pid=116474) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 14:25:25.061001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97e2c234-0b4e-4a25-b6fa-8da767d80234',volume_size=None,volume_type=None)] {{(pid=116474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 14:25:25.193827 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0919a4dc-33b4-4d58-bb97-5c8244c1eb33 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761024 Jan 11 14:25:25.205352 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 717/1422] 10.222.0.49 () {60 vars in 1146 bytes} [Tue Jan 11 14:25:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 14:25:25.210207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-95b4dd1c-eceb-440f-9d6f-3f39dd114a78 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:25.211024 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-95b4dd1c-eceb-440f-9d6f-3f39dd114a78 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:25.273730 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-95b4dd1c-eceb-440f-9d6f-3f39dd114a78 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:25.280541 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-95b4dd1c-eceb-440f-9d6f-3f39dd114a78 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1088 microversion: 2.1 time: 0.074035 Jan 11 14:25:25.281442 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 706/1423] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:25 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:26.296741 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f5982dc6-428a-4e15-8d7d-4285f4c2b8f3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:26.298000 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f5982dc6-428a-4e15-8d7d-4285f4c2b8f3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:26.306527 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5982dc6-428a-4e15-8d7d-4285f4c2b8f3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:26.307028 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5982dc6-428a-4e15-8d7d-4285f4c2b8f3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:26.307879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5982dc6-428a-4e15-8d7d-4285f4c2b8f3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:26.308551 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f5982dc6-428a-4e15-8d7d-4285f4c2b8f3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:26.376359 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f5982dc6-428a-4e15-8d7d-4285f4c2b8f3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:26.384325 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f5982dc6-428a-4e15-8d7d-4285f4c2b8f3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1204 microversion: 2.1 time: 0.091144 Jan 11 14:25:26.387642 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 718/1424] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:26 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:27.407395 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ba35e8db-05be-4a27-a7ff-3fea32c28e2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:27.407395 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ba35e8db-05be-4a27-a7ff-3fea32c28e2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:27.411671 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba35e8db-05be-4a27-a7ff-3fea32c28e2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:27.412125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba35e8db-05be-4a27-a7ff-3fea32c28e2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:27.413011 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba35e8db-05be-4a27-a7ff-3fea32c28e2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:27.413664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ba35e8db-05be-4a27-a7ff-3fea32c28e2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:27.520892 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-ce7de308-3ab2-4130-873a-3bed18cb3f94 req-ad24e05a-aad5-4d12-94b4-31af3a0d030a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ab8a6c-2c89-43b7-9554-1513f3ff0ee9", "tag": "64f13744-49dc-4efc-923d-e507c7abd6bf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:27.525128 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:25:27.525128 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:25:27.559628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-ce7de308-3ab2-4130-873a-3bed18cb3f94 req-ad24e05a-aad5-4d12-94b4-31af3a0d030a service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:27.564055 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-ce7de308-3ab2-4130-873a-3bed18cb3f94 req-ad24e05a-aad5-4d12-94b4-31af3a0d030a service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:27.582045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-ce7de308-3ab2-4130-873a-3bed18cb3f94 req-ad24e05a-aad5-4d12-94b4-31af3a0d030a service nova] Creating event network-changed:64f13744-49dc-4efc-923d-e507c7abd6bf for instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 on hv-cinder-82413 Jan 11 14:25:27.593783 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-ce7de308-3ab2-4130-873a-3bed18cb3f94 req-ad24e05a-aad5-4d12-94b4-31af3a0d030a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083486 Jan 11 14:25:27.594372 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 719/1425] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:25:27.603928 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ba35e8db-05be-4a27-a7ff-3fea32c28e2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:27.613106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ba35e8db-05be-4a27-a7ff-3fea32c28e2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.214452 Jan 11 14:25:27.614551 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 707/1426] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:27 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:28.630755 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-5a17d01c-9517-40fa-865d-ca4522b7f86a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:28.631364 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-5a17d01c-9517-40fa-865d-ca4522b7f86a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:28.637867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5a17d01c-9517-40fa-865d-ca4522b7f86a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:28.638317 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5a17d01c-9517-40fa-865d-ca4522b7f86a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:28.639088 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5a17d01c-9517-40fa-865d-ca4522b7f86a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:28.639547 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-5a17d01c-9517-40fa-865d-ca4522b7f86a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:28.773571 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-5a17d01c-9517-40fa-865d-ca4522b7f86a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:28.781263 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-5a17d01c-9517-40fa-865d-ca4522b7f86a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.154636 Jan 11 14:25:28.781824 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 720/1427] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:28 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:25:29.797933 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-f8563e03-3269-43d2-9d3d-3ca76062fbd3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:29.798544 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-f8563e03-3269-43d2-9d3d-3ca76062fbd3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:29.804825 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f8563e03-3269-43d2-9d3d-3ca76062fbd3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:29.805271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f8563e03-3269-43d2-9d3d-3ca76062fbd3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:29.806039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f8563e03-3269-43d2-9d3d-3ca76062fbd3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:29.806470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-f8563e03-3269-43d2-9d3d-3ca76062fbd3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:29.940732 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-f8563e03-3269-43d2-9d3d-3ca76062fbd3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:29.948535 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-f8563e03-3269-43d2-9d3d-3ca76062fbd3 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.154469 Jan 11 14:25:29.949111 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 708/1428] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:29 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:30.964811 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-53b90874-b89a-44fd-a20e-dcda0daedb97 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:30.965344 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-53b90874-b89a-44fd-a20e-dcda0daedb97 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:30.971608 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53b90874-b89a-44fd-a20e-dcda0daedb97 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:30.972077 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53b90874-b89a-44fd-a20e-dcda0daedb97 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:30.972831 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53b90874-b89a-44fd-a20e-dcda0daedb97 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:30.973265 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-53b90874-b89a-44fd-a20e-dcda0daedb97 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:31.098711 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-53b90874-b89a-44fd-a20e-dcda0daedb97 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:31.105919 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-53b90874-b89a-44fd-a20e-dcda0daedb97 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.144850 Jan 11 14:25:31.106480 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 721/1429] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:30 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:32.122615 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-03334651-daf3-42f7-b4b6-ea3eac9077f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:32.123161 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-03334651-daf3-42f7-b4b6-ea3eac9077f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:32.129272 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03334651-daf3-42f7-b4b6-ea3eac9077f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:32.129713 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03334651-daf3-42f7-b4b6-ea3eac9077f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:32.130652 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03334651-daf3-42f7-b4b6-ea3eac9077f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:32.130902 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03334651-daf3-42f7-b4b6-ea3eac9077f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:32.262856 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-03334651-daf3-42f7-b4b6-ea3eac9077f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:32.270522 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-03334651-daf3-42f7-b4b6-ea3eac9077f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.151784 Jan 11 14:25:32.271090 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 709/1430] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:32 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:33.287410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d535812b-0c91-48e6-8edb-958b7b95fb5f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:33.288059 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d535812b-0c91-48e6-8edb-958b7b95fb5f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:33.295235 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d535812b-0c91-48e6-8edb-958b7b95fb5f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:33.295733 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d535812b-0c91-48e6-8edb-958b7b95fb5f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:33.296515 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d535812b-0c91-48e6-8edb-958b7b95fb5f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:33.296949 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d535812b-0c91-48e6-8edb-958b7b95fb5f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:33.424715 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d535812b-0c91-48e6-8edb-958b7b95fb5f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:33.431894 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d535812b-0c91-48e6-8edb-958b7b95fb5f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.148086 Jan 11 14:25:33.432456 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 722/1431] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:33 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:34.448869 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9d54e167-23cb-43b1-b564-a9de71480abc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:34.449478 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9d54e167-23cb-43b1-b564-a9de71480abc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:34.455823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9d54e167-23cb-43b1-b564-a9de71480abc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:34.456268 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9d54e167-23cb-43b1-b564-a9de71480abc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:34.457040 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9d54e167-23cb-43b1-b564-a9de71480abc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:34.457470 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9d54e167-23cb-43b1-b564-a9de71480abc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:34.586433 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9d54e167-23cb-43b1-b564-a9de71480abc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:34.594579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9d54e167-23cb-43b1-b564-a9de71480abc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.149648 Jan 11 14:25:34.595138 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 710/1432] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:34 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:35.610219 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-86377550-53f6-406e-8c12-3f7b0a0b5720 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:35.610985 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-86377550-53f6-406e-8c12-3f7b0a0b5720 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:35.618528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-86377550-53f6-406e-8c12-3f7b0a0b5720 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:35.619023 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-86377550-53f6-406e-8c12-3f7b0a0b5720 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:35.619970 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-86377550-53f6-406e-8c12-3f7b0a0b5720 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:35.620626 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-86377550-53f6-406e-8c12-3f7b0a0b5720 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:35.762910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-86377550-53f6-406e-8c12-3f7b0a0b5720 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:35.778001 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-86377550-53f6-406e-8c12-3f7b0a0b5720 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.171429 Jan 11 14:25:35.778609 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 723/1433] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:35 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:36.794684 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4c93c815-9d05-494b-babd-0c26a5600dc8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:36.795296 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4c93c815-9d05-494b-babd-0c26a5600dc8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:36.801218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4c93c815-9d05-494b-babd-0c26a5600dc8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:36.801669 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4c93c815-9d05-494b-babd-0c26a5600dc8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:36.802454 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4c93c815-9d05-494b-babd-0c26a5600dc8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:36.802887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4c93c815-9d05-494b-babd-0c26a5600dc8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:36.935748 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4c93c815-9d05-494b-babd-0c26a5600dc8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:36.943009 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4c93c815-9d05-494b-babd-0c26a5600dc8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.151995 Jan 11 14:25:36.943595 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 711/1434] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:36 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:37.960388 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6c11cfdc-f74f-4f8e-8a62-3ca19d64ba70 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:37.960907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6c11cfdc-f74f-4f8e-8a62-3ca19d64ba70 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:37.967538 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c11cfdc-f74f-4f8e-8a62-3ca19d64ba70 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:37.967992 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c11cfdc-f74f-4f8e-8a62-3ca19d64ba70 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:37.968774 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c11cfdc-f74f-4f8e-8a62-3ca19d64ba70 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:37.969210 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6c11cfdc-f74f-4f8e-8a62-3ca19d64ba70 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:38.096454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6c11cfdc-f74f-4f8e-8a62-3ca19d64ba70 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:38.103646 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6c11cfdc-f74f-4f8e-8a62-3ca19d64ba70 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.146968 Jan 11 14:25:38.104248 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 724/1435] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:37 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:39.119993 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-e62780ab-31c2-43c5-8c78-a13485de9b56 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:39.120517 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-e62780ab-31c2-43c5-8c78-a13485de9b56 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:39.126698 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e62780ab-31c2-43c5-8c78-a13485de9b56 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:39.127146 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e62780ab-31c2-43c5-8c78-a13485de9b56 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:39.127961 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e62780ab-31c2-43c5-8c78-a13485de9b56 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:39.128397 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-e62780ab-31c2-43c5-8c78-a13485de9b56 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:39.263206 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-e62780ab-31c2-43c5-8c78-a13485de9b56 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:39.270509 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-e62780ab-31c2-43c5-8c78-a13485de9b56 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.154292 Jan 11 14:25:39.271077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 712/1436] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:39 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:40.287614 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-23c4847e-3747-44af-bfdd-faf7a8bfe451 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:40.288264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-23c4847e-3747-44af-bfdd-faf7a8bfe451 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:40.295041 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-23c4847e-3747-44af-bfdd-faf7a8bfe451 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:40.295487 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-23c4847e-3747-44af-bfdd-faf7a8bfe451 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:40.296290 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-23c4847e-3747-44af-bfdd-faf7a8bfe451 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:40.296729 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-23c4847e-3747-44af-bfdd-faf7a8bfe451 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:40.423657 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-23c4847e-3747-44af-bfdd-faf7a8bfe451 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:40.430759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-23c4847e-3747-44af-bfdd-faf7a8bfe451 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.146803 Jan 11 14:25:40.431317 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 725/1437] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:40 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:41.448061 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-a2ff49ae-a088-4086-bb7c-ab2b6b2c8690 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:41.448810 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-a2ff49ae-a088-4086-bb7c-ab2b6b2c8690 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:41.455590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a2ff49ae-a088-4086-bb7c-ab2b6b2c8690 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:41.456043 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a2ff49ae-a088-4086-bb7c-ab2b6b2c8690 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:41.456823 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a2ff49ae-a088-4086-bb7c-ab2b6b2c8690 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:41.457262 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-a2ff49ae-a088-4086-bb7c-ab2b6b2c8690 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:41.590653 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-a2ff49ae-a088-4086-bb7c-ab2b6b2c8690 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:41.597998 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-a2ff49ae-a088-4086-bb7c-ab2b6b2c8690 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.153977 Jan 11 14:25:41.598566 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 713/1438] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:41 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:42.613946 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d711b926-a265-4cff-a395-5927364ae661 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:42.614550 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d711b926-a265-4cff-a395-5927364ae661 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:42.620762 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d711b926-a265-4cff-a395-5927364ae661 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:42.621204 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d711b926-a265-4cff-a395-5927364ae661 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:42.621977 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d711b926-a265-4cff-a395-5927364ae661 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:42.622405 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d711b926-a265-4cff-a395-5927364ae661 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:42.752975 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d711b926-a265-4cff-a395-5927364ae661 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:42.760482 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d711b926-a265-4cff-a395-5927364ae661 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.150186 Jan 11 14:25:42.761056 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 726/1439] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:42 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:43.078785 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-76a93f24-b14a-4a9f-b708-ddbd5d286414 req-208585ce-d67a-4571-a31f-3a8e09a4b8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab8a6c-2c89-43b7-9554-1513f3ff0ee9", "name": "network-vif-plugged", "status": "completed", "tag": "64f13744-49dc-4efc-923d-e507c7abd6bf"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:43.080395 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:25:43.080395 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:25:43.087710 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-76a93f24-b14a-4a9f-b708-ddbd5d286414 req-208585ce-d67a-4571-a31f-3a8e09a4b8ac service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:43.088201 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-76a93f24-b14a-4a9f-b708-ddbd5d286414 req-208585ce-d67a-4571-a31f-3a8e09a4b8ac service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:43.099612 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-76a93f24-b14a-4a9f-b708-ddbd5d286414 req-208585ce-d67a-4571-a31f-3a8e09a4b8ac service nova] Creating event network-vif-plugged:64f13744-49dc-4efc-923d-e507c7abd6bf for instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 on hv-cinder-82413 Jan 11 14:25:43.104471 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-76a93f24-b14a-4a9f-b708-ddbd5d286414 req-208585ce-d67a-4571-a31f-3a8e09a4b8ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029993 Jan 11 14:25:43.105145 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 714/1440] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:25:43.777247 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-fa7a4d4b-9372-4807-89f3-401c2a5e51c1 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:43.777856 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-fa7a4d4b-9372-4807-89f3-401c2a5e51c1 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:43.784634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fa7a4d4b-9372-4807-89f3-401c2a5e51c1 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:43.785085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fa7a4d4b-9372-4807-89f3-401c2a5e51c1 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:43.785855 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fa7a4d4b-9372-4807-89f3-401c2a5e51c1 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:43.786295 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-fa7a4d4b-9372-4807-89f3-401c2a5e51c1 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:43.912802 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-fa7a4d4b-9372-4807-89f3-401c2a5e51c1 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:43.920668 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-fa7a4d4b-9372-4807-89f3-401c2a5e51c1 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1259 microversion: 2.1 time: 0.147002 Jan 11 14:25:43.921223 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 727/1441] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:43 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:44.940008 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-32198cf1-f636-4550-81d8-4c9affafe844 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:44.940742 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-32198cf1-f636-4550-81d8-4c9affafe844 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:44.946836 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32198cf1-f636-4550-81d8-4c9affafe844 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:44.947292 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32198cf1-f636-4550-81d8-4c9affafe844 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:44.948387 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32198cf1-f636-4550-81d8-4c9affafe844 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:44.948830 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-32198cf1-f636-4550-81d8-4c9affafe844 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:45.083590 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-32198cf1-f636-4550-81d8-4c9affafe844 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:45.091329 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-32198cf1-f636-4550-81d8-4c9affafe844 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1441 microversion: 2.1 time: 0.157341 Jan 11 14:25:45.091922 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 715/1442] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:44 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1441 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:25:45.107743 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-dce5a246-43fd-42c0-906e-ab5f04262a1b tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:25:45.108355 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-dce5a246-43fd-42c0-906e-ab5f04262a1b tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:25:45.114634 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dce5a246-43fd-42c0-906e-ab5f04262a1b tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:45.115087 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dce5a246-43fd-42c0-906e-ab5f04262a1b tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:45.115901 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dce5a246-43fd-42c0-906e-ab5f04262a1b tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:45.116341 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-dce5a246-43fd-42c0-906e-ab5f04262a1b tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:45.248655 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-dce5a246-43fd-42c0-906e-ab5f04262a1b tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:25:45.256093 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-dce5a246-43fd-42c0-906e-ab5f04262a1b tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1441 microversion: 2.1 time: 0.152585 Jan 11 14:25:45.256655 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 728/1443] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:25:45 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1441 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:25:46.946125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-48a848f4-0bc1-4b9a-b646-f1be0f6cadc3 req-3ee56ca8-c28c-4fd0-8575-9ca14ca8024a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ab8a6c-2c89-43b7-9554-1513f3ff0ee9", "tag": "64f13744-49dc-4efc-923d-e507c7abd6bf"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:25:46.948018 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:25:46.948018 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:25:46.956489 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-48a848f4-0bc1-4b9a-b646-f1be0f6cadc3 req-3ee56ca8-c28c-4fd0-8575-9ca14ca8024a service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:25:46.956936 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-48a848f4-0bc1-4b9a-b646-f1be0f6cadc3 req-3ee56ca8-c28c-4fd0-8575-9ca14ca8024a service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:25:46.968128 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-48a848f4-0bc1-4b9a-b646-f1be0f6cadc3 req-3ee56ca8-c28c-4fd0-8575-9ca14ca8024a service nova] Creating event network-changed:64f13744-49dc-4efc-923d-e507c7abd6bf for instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 on hv-cinder-82413 Jan 11 14:25:46.973112 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-48a848f4-0bc1-4b9a-b646-f1be0f6cadc3 req-3ee56ca8-c28c-4fd0-8575-9ca14ca8024a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030559 Jan 11 14:25:46.973754 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 716/1444] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:27:07.352264 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:27:07.352765 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:27:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:27:09.767320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-976489bc-918d-4f22-a5dc-fb7eb2a1ca3d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:09.767964 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-976489bc-918d-4f22-a5dc-fb7eb2a1ca3d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:09.771657 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-ea1d7a7d-1167-4b31-aadb-d298d71e4b97 req-afcaa7e3-f2b8-47a9-a489-0c3d526b3d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e808871-d76c-4ed2-8cac-bf9d1732ec3a", "tag": "5599536b-3bf6-4ae9-a675-b0498bc7116e"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:27:09.773212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:27:09.773212 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:27:09.773710 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-976489bc-918d-4f22-a5dc-fb7eb2a1ca3d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:09.774158 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-976489bc-918d-4f22-a5dc-fb7eb2a1ca3d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:09.774967 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-976489bc-918d-4f22-a5dc-fb7eb2a1ca3d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:09.775394 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-976489bc-918d-4f22-a5dc-fb7eb2a1ca3d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:09.780777 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-ea1d7a7d-1167-4b31-aadb-d298d71e4b97 req-afcaa7e3-f2b8-47a9-a489-0c3d526b3d4e service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:09.781300 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-ea1d7a7d-1167-4b31-aadb-d298d71e4b97 req-afcaa7e3-f2b8-47a9-a489-0c3d526b3d4e service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:09.792127 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-ea1d7a7d-1167-4b31-aadb-d298d71e4b97 req-afcaa7e3-f2b8-47a9-a489-0c3d526b3d4e service nova] Creating event network-changed:5599536b-3bf6-4ae9-a675-b0498bc7116e for instance 9e808871-d76c-4ed2-8cac-bf9d1732ec3a on hv-cinder-82413 Jan 11 14:27:09.797367 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-ea1d7a7d-1167-4b31-aadb-d298d71e4b97 req-afcaa7e3-f2b8-47a9-a489-0c3d526b3d4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032833 Jan 11 14:27:09.798396 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 717/1445] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:27:09.800550 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-976489bc-918d-4f22-a5dc-fb7eb2a1ca3d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:27:09.883402 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-976489bc-918d-4f22-a5dc-fb7eb2a1ca3d tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 204 len: 0 microversion: 2.1 time: 0.121407 Jan 11 14:27:09.884148 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 729/1446] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:27:09 2022] DELETE /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:27:09.894814 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-d2da90fa-6ad9-4912-b67b-18a4ea8fb774 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:09.895700 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-d2da90fa-6ad9-4912-b67b-18a4ea8fb774 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:09.902934 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2da90fa-6ad9-4912-b67b-18a4ea8fb774 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:09.903838 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2da90fa-6ad9-4912-b67b-18a4ea8fb774 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:09.904990 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2da90fa-6ad9-4912-b67b-18a4ea8fb774 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:09.905687 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-d2da90fa-6ad9-4912-b67b-18a4ea8fb774 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:10.052048 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-d2da90fa-6ad9-4912-b67b-18a4ea8fb774 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:27:10.060170 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-d2da90fa-6ad9-4912-b67b-18a4ea8fb774 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1579 microversion: 2.1 time: 0.170927 Jan 11 14:27:10.061371 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 718/1447] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:09 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:27:11.079328 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-49804ad1-f797-4401-9ed4-2acdb5b00a1f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:11.080045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-49804ad1-f797-4401-9ed4-2acdb5b00a1f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:11.086248 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-49804ad1-f797-4401-9ed4-2acdb5b00a1f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:11.086688 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-49804ad1-f797-4401-9ed4-2acdb5b00a1f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:11.087481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-49804ad1-f797-4401-9ed4-2acdb5b00a1f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:11.087936 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-49804ad1-f797-4401-9ed4-2acdb5b00a1f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:11.224192 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-49804ad1-f797-4401-9ed4-2acdb5b00a1f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:27:11.231436 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-49804ad1-f797-4401-9ed4-2acdb5b00a1f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1460 microversion: 2.1 time: 0.156868 Jan 11 14:27:11.232073 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 730/1448] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:11 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1460 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:27:12.178219 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-7f71f854-9041-4f73-aa3e-9692114676e7 req-b81179fc-fbe9-4ff4-a71c-1271ce256041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e808871-d76c-4ed2-8cac-bf9d1732ec3a", "name": "network-vif-deleted", "tag": "5599536b-3bf6-4ae9-a675-b0498bc7116e"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:27:12.179752 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:27:12.179752 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:27:12.187096 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-7f71f854-9041-4f73-aa3e-9692114676e7 req-b81179fc-fbe9-4ff4-a71c-1271ce256041 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:12.187559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-7f71f854-9041-4f73-aa3e-9692114676e7 req-b81179fc-fbe9-4ff4-a71c-1271ce256041 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:12.198786 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-7f71f854-9041-4f73-aa3e-9692114676e7 req-b81179fc-fbe9-4ff4-a71c-1271ce256041 service nova] Creating event network-vif-deleted:5599536b-3bf6-4ae9-a675-b0498bc7116e for instance 9e808871-d76c-4ed2-8cac-bf9d1732ec3a on hv-cinder-82413 Jan 11 14:27:12.203919 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-7f71f854-9041-4f73-aa3e-9692114676e7 req-b81179fc-fbe9-4ff4-a71c-1271ce256041 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029272 Jan 11 14:27:12.204500 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 719/1449] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:27:12.249861 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9dce5cd7-7587-4c6d-a867-2fae0647e1dd tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:12.250472 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9dce5cd7-7587-4c6d-a867-2fae0647e1dd tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:12.256699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9dce5cd7-7587-4c6d-a867-2fae0647e1dd tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:12.257160 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9dce5cd7-7587-4c6d-a867-2fae0647e1dd tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:12.257949 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9dce5cd7-7587-4c6d-a867-2fae0647e1dd tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:12.258388 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9dce5cd7-7587-4c6d-a867-2fae0647e1dd tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:12.316228 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9dce5cd7-7587-4c6d-a867-2fae0647e1dd tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:27:12.323636 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9dce5cd7-7587-4c6d-a867-2fae0647e1dd tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 200 len: 1225 microversion: 2.1 time: 0.077996 Jan 11 14:27:12.324196 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 731/1450] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:12 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:27:13.341348 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:13.342039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 9e808871-d76c-4ed2-8cac-bf9d1732ec3a] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:13.348051 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:13.348499 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:13.349263 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:13.349695 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:13.363250 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] HTTP exception thrown: Instance 9e808871-d76c-4ed2-8cac-bf9d1732ec3a could not be found. Jan 11 14:27:13.363874 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Returning 404 to user: Instance 9e808871-d76c-4ed2-8cac-bf9d1732ec3a could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:27:13.364714 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0c5a316a-c007-47a3-81ea-b5579876835e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a" status: 404 len: 111 microversion: 2.1 time: 0.027792 Jan 11 14:27:13.365243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 720/1451] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:13 2022] GET /compute/v2.1/servers/9e808871-d76c-4ed2-8cac-bf9d1732ec3a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:27:16.408839 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-32e60898-8e6d-4b00-be86-cc155de57a0e req-18d7927d-a523-4a88-8fbe-500c85eb07be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f7f59c-094c-4dd0-bdd9-d0116cb8191e", "tag": "5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:27:16.410417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:27:16.410417 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:27:16.411698 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-ac6b75a8-c8a4-4e41-8d4f-09f6ef88e0b5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:16.412211 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ac6b75a8-c8a4-4e41-8d4f-09f6ef88e0b5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:16.417840 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-32e60898-8e6d-4b00-be86-cc155de57a0e req-18d7927d-a523-4a88-8fbe-500c85eb07be service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:16.418351 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-32e60898-8e6d-4b00-be86-cc155de57a0e req-18d7927d-a523-4a88-8fbe-500c85eb07be service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:16.418593 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac6b75a8-c8a4-4e41-8d4f-09f6ef88e0b5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:16.420370 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac6b75a8-c8a4-4e41-8d4f-09f6ef88e0b5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:16.420370 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac6b75a8-c8a4-4e41-8d4f-09f6ef88e0b5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:16.420600 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-ac6b75a8-c8a4-4e41-8d4f-09f6ef88e0b5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:16.429522 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-32e60898-8e6d-4b00-be86-cc155de57a0e req-18d7927d-a523-4a88-8fbe-500c85eb07be service nova] Creating event network-changed:5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4 for instance 10f7f59c-094c-4dd0-bdd9-d0116cb8191e on hv-cinder-82413 Jan 11 14:27:16.434367 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-32e60898-8e6d-4b00-be86-cc155de57a0e req-18d7927d-a523-4a88-8fbe-500c85eb07be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029728 Jan 11 14:27:16.434945 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 721/1452] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:27:16.450385 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-ac6b75a8-c8a4-4e41-8d4f-09f6ef88e0b5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Going to try to terminate instance {{(pid=116474) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:27:16.531193 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-ac6b75a8-c8a4-4e41-8d4f-09f6ef88e0b5 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "DELETE /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 204 len: 0 microversion: 2.1 time: 0.128984 Jan 11 14:27:16.531945 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 732/1453] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:27:16 2022] DELETE /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:27:16.540353 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-fe581e13-85d5-48fa-8502-1a1303b8d68e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:16.541049 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-fe581e13-85d5-48fa-8502-1a1303b8d68e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:16.547271 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe581e13-85d5-48fa-8502-1a1303b8d68e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:16.547757 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe581e13-85d5-48fa-8502-1a1303b8d68e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:16.548538 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe581e13-85d5-48fa-8502-1a1303b8d68e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:16.549205 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-fe581e13-85d5-48fa-8502-1a1303b8d68e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:16.692182 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-fe581e13-85d5-48fa-8502-1a1303b8d68e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:27:16.701636 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-fe581e13-85d5-48fa-8502-1a1303b8d68e tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1578 microversion: 2.1 time: 0.165457 Jan 11 14:27:16.704162 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 722/1454] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:16 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:27:17.720069 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-da8dc482-c327-4707-9979-00317f3e7301 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:17.720764 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-da8dc482-c327-4707-9979-00317f3e7301 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:17.726964 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-da8dc482-c327-4707-9979-00317f3e7301 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:17.727414 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-da8dc482-c327-4707-9979-00317f3e7301 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:17.728227 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-da8dc482-c327-4707-9979-00317f3e7301 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:17.728661 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-da8dc482-c327-4707-9979-00317f3e7301 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:17.865163 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-da8dc482-c327-4707-9979-00317f3e7301 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:27:17.872517 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-da8dc482-c327-4707-9979-00317f3e7301 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1459 microversion: 2.1 time: 0.157149 Jan 11 14:27:17.873085 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 733/1455] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:17 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:27:18.493813 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [req-422e4526-b88d-4f48-8f24-7bebb2dfaf9a req-35f496cc-f243-44be-bc45-e003c14b4a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f7f59c-094c-4dd0-bdd9-d0116cb8191e", "name": "network-vif-deleted", "tag": "5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4"}]} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:27:18.495444 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:27:18.495444 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: warnings.warn(msg) Jan 11 14:27:18.506539 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-422e4526-b88d-4f48-8f24-7bebb2dfaf9a req-35f496cc-f243-44be-bc45-e003c14b4a73 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:18.506999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [req-422e4526-b88d-4f48-8f24-7bebb2dfaf9a req-35f496cc-f243-44be-bc45-e003c14b4a73 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:18.519716 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.compute.server_external_events [req-422e4526-b88d-4f48-8f24-7bebb2dfaf9a req-35f496cc-f243-44be-bc45-e003c14b4a73 service nova] Creating event network-vif-deleted:5e6ed9ed-8e33-4719-9a3b-5c91d2d171c4 for instance 10f7f59c-094c-4dd0-bdd9-d0116cb8191e on hv-cinder-82413 Jan 11 14:27:18.524388 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [req-422e4526-b88d-4f48-8f24-7bebb2dfaf9a req-35f496cc-f243-44be-bc45-e003c14b4a73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034152 Jan 11 14:27:18.524981 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 723/1456] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:27:18.889521 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:18.890127 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:18.896520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:18.896961 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:18.897750 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:18.898175 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:18.929923 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:18.930372 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:18.930822 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.objects.instance [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lazy-loading 'fault' on Instance uuid 10f7f59c-094c-4dd0-bdd9-d0116cb8191e {{(pid=116474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:27:18.969302 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f2499d9bdf4026b5f6b310d3e0b21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135a305e0bbe4cfcbfea666d19340195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:27:18.976464 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-e793211c-04d4-4f3b-9a80-1372419c4e18 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 200 len: 1230 microversion: 2.1 time: 0.090666 Jan 11 14:27:18.977019 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 734/1457] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:18 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:27:19.994975 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:19.995630 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 10f7f59c-094c-4dd0-bdd9-d0116cb8191e] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:20.002221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:20.002661 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:20.003423 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:20.003876 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:20.016670 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] HTTP exception thrown: Instance 10f7f59c-094c-4dd0-bdd9-d0116cb8191e could not be found. Jan 11 14:27:20.017243 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Returning 404 to user: Instance 10f7f59c-094c-4dd0-bdd9-d0116cb8191e could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:27:20.018042 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-08240a08-3e26-4daf-8f81-9f31d786c11f tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e" status: 404 len: 111 microversion: 2.1 time: 0.027790 Jan 11 14:27:20.018548 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 724/1458] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:19 2022] GET /compute/v2.1/servers/10f7f59c-094c-4dd0-bdd9-d0116cb8191e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:27:20.453499 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:20.454026 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:20.460175 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:20.460620 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:20.461387 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:20.461816 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:20.475333 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] HTTP exception thrown: Instance 201aaa53-5bdd-4883-a883-71b16db0ec92 could not be found. Jan 11 14:27:20.476042 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Returning 404 to user: Instance 201aaa53-5bdd-4883-a883-71b16db0ec92 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:27:20.476835 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-faef9e99-bdb3-4e0e-9a18-52873be0b9b8 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "DELETE /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 404 len: 111 microversion: 2.1 time: 0.027075 Jan 11 14:27:20.477341 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 735/1459] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:27:20 2022] DELETE /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:27:20.485709 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:20.486324 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] [instance: 201aaa53-5bdd-4883-a883-71b16db0ec92] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:27:20.492099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:20.492551 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:20.493325 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:27:20.493762 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:27:20.506594 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.wsgi [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] HTTP exception thrown: Instance 201aaa53-5bdd-4883-a883-71b16db0ec92 could not be found. Jan 11 14:27:20.507177 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Returning 404 to user: Instance 201aaa53-5bdd-4883-a883-71b16db0ec92 could not be found. {{(pid=116475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:27:20.508028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4bdb6001-20fe-4d9b-92fe-4bf4e17007bc tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92" status: 404 len: 111 microversion: 2.1 time: 0.026664 Jan 11 14:27:20.508554 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 725/1460] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:27:20 2022] GET /compute/v2.1/servers/201aaa53-5bdd-4883-a883-71b16db0ec92 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:27:21.775781 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-efba3db6-2c82-44be-a2b4-6f41bed4af56 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] Calling method '.version_select at 0x7fba926c3a60>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:27:21.798610 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-efba3db6-2c82-44be-a2b4-6f41bed4af56 tempest-TestVolumeBootPattern-1517301868 tempest-TestVolumeBootPattern-1517301868-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1740982666" status: 202 len: 0 microversion: 2.1 time: 0.026485 Jan 11 14:27:21.799580 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 736/1461] 10.222.0.49 () {58 vars in 1262 bytes} [Tue Jan 11 14:27:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1740982666 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:28:02.577119 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:28:02.577674 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: Tue Jan 11 14:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:28:05.860202 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:28:05.860805 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: Tue Jan 11 14:28:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:28:06.605759 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:28:06.606347 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:28:13.544828 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b81cd1e0-33d4-498c-a6cb-e810c4e269d8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:28:13.545384 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b81cd1e0-33d4-498c-a6cb-e810c4e269d8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:13.551892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b81cd1e0-33d4-498c-a6cb-e810c4e269d8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:13.552348 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b81cd1e0-33d4-498c-a6cb-e810c4e269d8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:13.553165 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b81cd1e0-33d4-498c-a6cb-e810c4e269d8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:13.553602 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b81cd1e0-33d4-498c-a6cb-e810c4e269d8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:13.575827 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.objects.instance [None req-b81cd1e0-33d4-498c-a6cb-e810c4e269d8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lazy-loading 'flavor' on Instance uuid 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 {{(pid=116475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 14:28:13.646301 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b81cd1e0-33d4-498c-a6cb-e810c4e269d8 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "POST /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9/action" status: 202 len: 0 microversion: 2.1 time: 0.105402 Jan 11 14:28:13.646879 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 726/1462] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:28:13 2022] POST /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:28:13.655179 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-adb8ab88-79bf-4912-bca0-9abef06084ef tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:13.656500 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-adb8ab88-79bf-4912-bca0-9abef06084ef tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:13.659768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4731a706-d809-496d-990c-8220a09754e3] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 11 14:28:13.664910 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-adb8ab88-79bf-4912-bca0-9abef06084ef tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:13.665370 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-adb8ab88-79bf-4912-bca0-9abef06084ef tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:13.666253 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-adb8ab88-79bf-4912-bca0-9abef06084ef tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:13.666688 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-adb8ab88-79bf-4912-bca0-9abef06084ef tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:13.798041 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-adb8ab88-79bf-4912-bca0-9abef06084ef tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:13.805303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-adb8ab88-79bf-4912-bca0-9abef06084ef tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.153901 Jan 11 14:28:13.805867 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 737/1463] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:13 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:14.823682 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-aa08baeb-8f97-4c60-bb65-239e30b65c9a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:14.824381 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-aa08baeb-8f97-4c60-bb65-239e30b65c9a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:14.830957 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa08baeb-8f97-4c60-bb65-239e30b65c9a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:14.831407 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa08baeb-8f97-4c60-bb65-239e30b65c9a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:14.832228 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa08baeb-8f97-4c60-bb65-239e30b65c9a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:14.832665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-aa08baeb-8f97-4c60-bb65-239e30b65c9a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:15.175423 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-aa08baeb-8f97-4c60-bb65-239e30b65c9a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:15.182712 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-aa08baeb-8f97-4c60-bb65-239e30b65c9a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.363946 Jan 11 14:28:15.183277 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 727/1464] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:14 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:16.200117 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-0bd87e35-d7b3-4625-857c-8bc14de45548 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:16.200826 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-0bd87e35-d7b3-4625-857c-8bc14de45548 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:16.210496 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0bd87e35-d7b3-4625-857c-8bc14de45548 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:16.210997 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0bd87e35-d7b3-4625-857c-8bc14de45548 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:16.211768 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0bd87e35-d7b3-4625-857c-8bc14de45548 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:16.212239 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-0bd87e35-d7b3-4625-857c-8bc14de45548 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:16.217315 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] [4731a706-d809-496d-990c-8220a09754e3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37230. Jan 11 14:28:16.339618 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-0bd87e35-d7b3-4625-857c-8bc14de45548 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:16.347371 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-0bd87e35-d7b3-4625-857c-8bc14de45548 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.150903 Jan 11 14:28:16.347964 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 738/1465] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:16 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:17.364123 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0518ec07-ed05-46fb-9077-2cd4a4255c85 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:17.364771 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0518ec07-ed05-46fb-9077-2cd4a4255c85 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:17.370925 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0518ec07-ed05-46fb-9077-2cd4a4255c85 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:17.371377 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0518ec07-ed05-46fb-9077-2cd4a4255c85 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:17.372183 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0518ec07-ed05-46fb-9077-2cd4a4255c85 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:17.372621 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0518ec07-ed05-46fb-9077-2cd4a4255c85 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:17.502895 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0518ec07-ed05-46fb-9077-2cd4a4255c85 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:17.510083 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0518ec07-ed05-46fb-9077-2cd4a4255c85 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.149582 Jan 11 14:28:17.510637 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 728/1466] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:17 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:18.527053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-6f6f17d6-9880-4a2e-b562-3d4bd5b990b0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:18.527683 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-6f6f17d6-9880-4a2e-b562-3d4bd5b990b0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:18.534481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f6f17d6-9880-4a2e-b562-3d4bd5b990b0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:18.534926 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f6f17d6-9880-4a2e-b562-3d4bd5b990b0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:18.535721 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f6f17d6-9880-4a2e-b562-3d4bd5b990b0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:18.536150 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-6f6f17d6-9880-4a2e-b562-3d4bd5b990b0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:18.721094 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-6f6f17d6-9880-4a2e-b562-3d4bd5b990b0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:18.728979 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-6f6f17d6-9880-4a2e-b562-3d4bd5b990b0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.205581 Jan 11 14:28:18.729546 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 739/1467] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:18 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:19.745803 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0fa47ec6-ad7c-44b3-8b4f-84c49dce0013 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:19.746410 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0fa47ec6-ad7c-44b3-8b4f-84c49dce0013 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:19.752635 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0fa47ec6-ad7c-44b3-8b4f-84c49dce0013 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:19.753077 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0fa47ec6-ad7c-44b3-8b4f-84c49dce0013 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:19.753842 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0fa47ec6-ad7c-44b3-8b4f-84c49dce0013 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:19.754278 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0fa47ec6-ad7c-44b3-8b4f-84c49dce0013 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:19.883692 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0fa47ec6-ad7c-44b3-8b4f-84c49dce0013 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:19.891483 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0fa47ec6-ad7c-44b3-8b4f-84c49dce0013 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.149349 Jan 11 14:28:19.892070 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 729/1468] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:19 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:20.908919 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-3a0c1cb1-2bdb-495f-89af-9c8843f47083 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:20.909540 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-3a0c1cb1-2bdb-495f-89af-9c8843f47083 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:20.915829 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3a0c1cb1-2bdb-495f-89af-9c8843f47083 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:20.916285 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3a0c1cb1-2bdb-495f-89af-9c8843f47083 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:20.917064 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3a0c1cb1-2bdb-495f-89af-9c8843f47083 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:20.917504 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-3a0c1cb1-2bdb-495f-89af-9c8843f47083 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:21.045185 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-3a0c1cb1-2bdb-495f-89af-9c8843f47083 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:21.053454 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-3a0c1cb1-2bdb-495f-89af-9c8843f47083 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.148737 Jan 11 14:28:21.054012 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 740/1469] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:20 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:22.069937 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-9706dc4e-53ca-43ae-9c7a-cd78a44041a4 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:22.070745 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-9706dc4e-53ca-43ae-9c7a-cd78a44041a4 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:22.077015 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9706dc4e-53ca-43ae-9c7a-cd78a44041a4 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:22.077469 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9706dc4e-53ca-43ae-9c7a-cd78a44041a4 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:22.078250 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9706dc4e-53ca-43ae-9c7a-cd78a44041a4 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:22.078691 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-9706dc4e-53ca-43ae-9c7a-cd78a44041a4 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:22.204349 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-9706dc4e-53ca-43ae-9c7a-cd78a44041a4 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:22.211643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-9706dc4e-53ca-43ae-9c7a-cd78a44041a4 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.145452 Jan 11 14:28:22.212211 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 730/1470] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:22 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:23.228938 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a4984383-d88e-4c14-8bdd-0a5f55c63f7f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:23.229550 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a4984383-d88e-4c14-8bdd-0a5f55c63f7f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:23.235818 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a4984383-d88e-4c14-8bdd-0a5f55c63f7f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:23.236266 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a4984383-d88e-4c14-8bdd-0a5f55c63f7f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:23.237048 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a4984383-d88e-4c14-8bdd-0a5f55c63f7f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:23.237481 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a4984383-d88e-4c14-8bdd-0a5f55c63f7f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:23.367065 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-a4984383-d88e-4c14-8bdd-0a5f55c63f7f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:23.375368 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a4984383-d88e-4c14-8bdd-0a5f55c63f7f tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.150166 Jan 11 14:28:23.375951 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 741/1471] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:23 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:24.392284 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-0426ff4c-9771-4ec1-8951-8898cc418b2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:24.392887 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-0426ff4c-9771-4ec1-8951-8898cc418b2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:24.399151 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0426ff4c-9771-4ec1-8951-8898cc418b2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:24.399643 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0426ff4c-9771-4ec1-8951-8898cc418b2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:24.400433 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0426ff4c-9771-4ec1-8951-8898cc418b2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:24.400871 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-0426ff4c-9771-4ec1-8951-8898cc418b2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:24.528234 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-0426ff4c-9771-4ec1-8951-8898cc418b2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:24.536097 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-0426ff4c-9771-4ec1-8951-8898cc418b2a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.147993 Jan 11 14:28:24.536664 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 731/1472] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:24 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:25.552699 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-81abeb9f-8813-42a3-9fd8-03fb30fb38e0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:25.553346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-81abeb9f-8813-42a3-9fd8-03fb30fb38e0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:25.559670 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-81abeb9f-8813-42a3-9fd8-03fb30fb38e0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:25.560123 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-81abeb9f-8813-42a3-9fd8-03fb30fb38e0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:25.560894 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-81abeb9f-8813-42a3-9fd8-03fb30fb38e0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:25.561346 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-81abeb9f-8813-42a3-9fd8-03fb30fb38e0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:25.695628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-81abeb9f-8813-42a3-9fd8-03fb30fb38e0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:25.703727 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-81abeb9f-8813-42a3-9fd8-03fb30fb38e0 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.154390 Jan 11 14:28:25.704024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 742/1473] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:25 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:26.720406 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-4f9fd64a-28f5-402a-8b14-fd580298fbaf tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:26.721057 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-4f9fd64a-28f5-402a-8b14-fd580298fbaf tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:26.728072 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4f9fd64a-28f5-402a-8b14-fd580298fbaf tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:26.728520 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4f9fd64a-28f5-402a-8b14-fd580298fbaf tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:26.729298 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4f9fd64a-28f5-402a-8b14-fd580298fbaf tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:26.729727 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-4f9fd64a-28f5-402a-8b14-fd580298fbaf tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:26.856675 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-4f9fd64a-28f5-402a-8b14-fd580298fbaf tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:26.864480 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-4f9fd64a-28f5-402a-8b14-fd580298fbaf tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1507 microversion: 2.1 time: 0.147921 Jan 11 14:28:26.865028 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 732/1474] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:26 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:28:26.880317 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-a50795e2-f1c1-4a61-a297-5b9c506131fc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:28:26.880885 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-a50795e2-f1c1-4a61-a297-5b9c506131fc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:26.887053 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a50795e2-f1c1-4a61-a297-5b9c506131fc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:26.887528 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a50795e2-f1c1-4a61-a297-5b9c506131fc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:26.888310 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a50795e2-f1c1-4a61-a297-5b9c506131fc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:26.888742 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-a50795e2-f1c1-4a61-a297-5b9c506131fc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:26.976711 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-a50795e2-f1c1-4a61-a297-5b9c506131fc tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "POST /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9/action" status: 202 len: 0 microversion: 2.1 time: 0.099878 Jan 11 14:28:26.977238 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 743/1475] 10.222.0.49 () {60 vars in 1277 bytes} [Tue Jan 11 14:28:26 2022] POST /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:28:26.986832 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-07b5094d-4777-476c-964f-f3134a5c5028 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:26.987985 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-07b5094d-4777-476c-964f-f3134a5c5028 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:26.993117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-07b5094d-4777-476c-964f-f3134a5c5028 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:26.993564 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-07b5094d-4777-476c-964f-f3134a5c5028 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:26.994347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-07b5094d-4777-476c-964f-f3134a5c5028 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:26.994783 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-07b5094d-4777-476c-964f-f3134a5c5028 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:27.158177 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-07b5094d-4777-476c-964f-f3134a5c5028 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:27.165778 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-07b5094d-4777-476c-964f-f3134a5c5028 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1515 microversion: 2.1 time: 0.184439 Jan 11 14:28:27.166351 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 733/1476] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:26 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:28:28.183943 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-f3e76191-c30f-4b3e-bbea-2b90b61887ce tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:28.184556 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-f3e76191-c30f-4b3e-bbea-2b90b61887ce tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:28.192337 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3e76191-c30f-4b3e-bbea-2b90b61887ce tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:28.192794 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3e76191-c30f-4b3e-bbea-2b90b61887ce tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:28.193590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3e76191-c30f-4b3e-bbea-2b90b61887ce tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:28.194024 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-f3e76191-c30f-4b3e-bbea-2b90b61887ce tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:28.330126 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-f3e76191-c30f-4b3e-bbea-2b90b61887ce tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:28.338789 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-f3e76191-c30f-4b3e-bbea-2b90b61887ce tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1573 microversion: 2.1 time: 0.159047 Jan 11 14:28:28.339358 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 744/1477] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:28 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:29.355797 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b7dde023-4da4-42e7-9b39-381a4e4002f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:29.356439 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b7dde023-4da4-42e7-9b39-381a4e4002f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:29.362650 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7dde023-4da4-42e7-9b39-381a4e4002f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:29.363099 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7dde023-4da4-42e7-9b39-381a4e4002f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:29.363909 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7dde023-4da4-42e7-9b39-381a4e4002f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:29.364344 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b7dde023-4da4-42e7-9b39-381a4e4002f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:29.493960 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b7dde023-4da4-42e7-9b39-381a4e4002f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:29.501837 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b7dde023-4da4-42e7-9b39-381a4e4002f7 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1573 microversion: 2.1 time: 0.149734 Jan 11 14:28:29.502394 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 734/1478] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:29 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:29.734412 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-39d85636-bc1d-4249-b0d0-2d32bccae663 req-1123d061-de81-4397-a402-d01f5b8b06ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab8a6c-2c89-43b7-9554-1513f3ff0ee9", "name": "network-vif-unplugged", "status": "completed", "tag": "64f13744-49dc-4efc-923d-e507c7abd6bf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:28:29.736045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:28:29.736045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:28:29.743402 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-39d85636-bc1d-4249-b0d0-2d32bccae663 req-1123d061-de81-4397-a402-d01f5b8b06ff service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:29.743868 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-39d85636-bc1d-4249-b0d0-2d32bccae663 req-1123d061-de81-4397-a402-d01f5b8b06ff service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:29.755455 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-39d85636-bc1d-4249-b0d0-2d32bccae663 req-1123d061-de81-4397-a402-d01f5b8b06ff service nova] Creating event network-vif-unplugged:64f13744-49dc-4efc-923d-e507c7abd6bf for instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 on hv-cinder-82413 Jan 11 14:28:29.760321 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-39d85636-bc1d-4249-b0d0-2d32bccae663 req-1123d061-de81-4397-a402-d01f5b8b06ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030024 Jan 11 14:28:29.760907 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 745/1479] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:28:30.519010 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-555c7f56-8bb5-457d-af7b-60698b50bf38 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:30.519646 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-555c7f56-8bb5-457d-af7b-60698b50bf38 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:30.526112 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-555c7f56-8bb5-457d-af7b-60698b50bf38 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:30.526562 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-555c7f56-8bb5-457d-af7b-60698b50bf38 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:30.527342 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-555c7f56-8bb5-457d-af7b-60698b50bf38 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:30.527801 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-555c7f56-8bb5-457d-af7b-60698b50bf38 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:30.657117 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-555c7f56-8bb5-457d-af7b-60698b50bf38 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:30.664386 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-555c7f56-8bb5-457d-af7b-60698b50bf38 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1573 microversion: 2.1 time: 0.149582 Jan 11 14:28:30.664949 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 735/1480] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:30 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 14:28:31.682209 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-7158992b-d2eb-4b18-94cd-1a1e94312519 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:31.682976 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-7158992b-d2eb-4b18-94cd-1a1e94312519 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:31.689043 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7158992b-d2eb-4b18-94cd-1a1e94312519 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:31.689486 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7158992b-d2eb-4b18-94cd-1a1e94312519 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:31.690255 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7158992b-d2eb-4b18-94cd-1a1e94312519 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:31.690685 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-7158992b-d2eb-4b18-94cd-1a1e94312519 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:31.823723 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-7158992b-d2eb-4b18-94cd-1a1e94312519 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:31.831019 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-7158992b-d2eb-4b18-94cd-1a1e94312519 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1573 microversion: 2.1 time: 0.153241 Jan 11 14:28:31.831613 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 746/1481] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:31 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:32.847369 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-03483bed-b756-4dab-9560-8b1ba12e9ac6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:32.848106 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-03483bed-b756-4dab-9560-8b1ba12e9ac6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:32.854347 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03483bed-b756-4dab-9560-8b1ba12e9ac6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:32.854795 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03483bed-b756-4dab-9560-8b1ba12e9ac6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:32.855605 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03483bed-b756-4dab-9560-8b1ba12e9ac6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:32.856039 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-03483bed-b756-4dab-9560-8b1ba12e9ac6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:32.985344 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-03483bed-b756-4dab-9560-8b1ba12e9ac6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:32.992651 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-03483bed-b756-4dab-9560-8b1ba12e9ac6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1573 microversion: 2.1 time: 0.148979 Jan 11 14:28:32.993207 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 736/1482] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:32 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:34.010062 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-23433355-3f4f-4dd9-ac65-2c4f7cc62a96 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:34.010606 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-23433355-3f4f-4dd9-ac65-2c4f7cc62a96 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:34.016927 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-23433355-3f4f-4dd9-ac65-2c4f7cc62a96 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:34.017383 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-23433355-3f4f-4dd9-ac65-2c4f7cc62a96 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:34.018172 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-23433355-3f4f-4dd9-ac65-2c4f7cc62a96 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:34.018613 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-23433355-3f4f-4dd9-ac65-2c4f7cc62a96 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:34.146410 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-23433355-3f4f-4dd9-ac65-2c4f7cc62a96 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:34.153691 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-23433355-3f4f-4dd9-ac65-2c4f7cc62a96 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1573 microversion: 2.1 time: 0.147353 Jan 11 14:28:34.154252 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 747/1483] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:34 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:35.170171 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-78b8f3e0-5dd1-4749-8c6b-3963f42c73db tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:35.170848 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-78b8f3e0-5dd1-4749-8c6b-3963f42c73db tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:35.177007 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-78b8f3e0-5dd1-4749-8c6b-3963f42c73db tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:35.177457 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-78b8f3e0-5dd1-4749-8c6b-3963f42c73db tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:35.178232 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-78b8f3e0-5dd1-4749-8c6b-3963f42c73db tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:35.178665 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-78b8f3e0-5dd1-4749-8c6b-3963f42c73db tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:35.309221 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-78b8f3e0-5dd1-4749-8c6b-3963f42c73db tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:35.317019 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-78b8f3e0-5dd1-4749-8c6b-3963f42c73db tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1573 microversion: 2.1 time: 0.150509 Jan 11 14:28:35.317579 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 737/1484] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:35 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:36.334069 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-d19663fc-ae96-4843-aad0-869d144cf35a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:36.334679 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-d19663fc-ae96-4843-aad0-869d144cf35a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:36.341034 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d19663fc-ae96-4843-aad0-869d144cf35a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:36.341477 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d19663fc-ae96-4843-aad0-869d144cf35a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:36.342281 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d19663fc-ae96-4843-aad0-869d144cf35a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:36.342709 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-d19663fc-ae96-4843-aad0-869d144cf35a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:36.469170 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-d19663fc-ae96-4843-aad0-869d144cf35a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:36.476357 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-d19663fc-ae96-4843-aad0-869d144cf35a tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1573 microversion: 2.1 time: 0.145941 Jan 11 14:28:36.476920 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 748/1485] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:36 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1573 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:37.492905 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-b64f3959-bf36-4a82-a2fc-696956f37342 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:28:37.493510 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-b64f3959-bf36-4a82-a2fc-696956f37342 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:28:37.499784 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b64f3959-bf36-4a82-a2fc-696956f37342 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:37.500231 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b64f3959-bf36-4a82-a2fc-696956f37342 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:37.500999 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b64f3959-bf36-4a82-a2fc-696956f37342 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:37.501429 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-b64f3959-bf36-4a82-a2fc-696956f37342 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:37.630562 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-b64f3959-bf36-4a82-a2fc-696956f37342 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:28:37.637735 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-b64f3959-bf36-4a82-a2fc-696956f37342 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1560 microversion: 2.1 time: 0.148477 Jan 11 14:28:37.638291 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 738/1486] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:28:37 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:28:39.834443 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-cdf9ec23-f634-4294-abe3-bd81978ef969 req-611a56c3-9be5-4f05-94ac-e896ae69dee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab8a6c-2c89-43b7-9554-1513f3ff0ee9", "name": "network-vif-plugged", "status": "completed", "tag": "64f13744-49dc-4efc-923d-e507c7abd6bf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:28:39.836045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:28:39.836045 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:28:39.843934 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-cdf9ec23-f634-4294-abe3-bd81978ef969 req-611a56c3-9be5-4f05-94ac-e896ae69dee1 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:28:39.844395 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-cdf9ec23-f634-4294-abe3-bd81978ef969 req-611a56c3-9be5-4f05-94ac-e896ae69dee1 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:28:39.857316 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-cdf9ec23-f634-4294-abe3-bd81978ef969 req-611a56c3-9be5-4f05-94ac-e896ae69dee1 service nova] Creating event network-vif-plugged:64f13744-49dc-4efc-923d-e507c7abd6bf for instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 on hv-cinder-82413 Jan 11 14:28:39.862846 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-cdf9ec23-f634-4294-abe3-bd81978ef969 req-611a56c3-9be5-4f05-94ac-e896ae69dee1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Jan 11 14:28:39.863628 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 749/1487] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 14:30:05.769306 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-6590a3ee-a2ac-4725-b940-5e4fed383d30 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:30:05.769841 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6590a3ee-a2ac-4725-b940-5e4fed383d30 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:30:05.772590 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-6654235b-2a66-4816-a44c-23192e207bbd req-e0668284-951f-46d9-929e-b5ba14317e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ab8a6c-2c89-43b7-9554-1513f3ff0ee9", "tag": "64f13744-49dc-4efc-923d-e507c7abd6bf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:30:05.774111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:30:05.774111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:30:05.776559 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6590a3ee-a2ac-4725-b940-5e4fed383d30 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:05.777376 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6590a3ee-a2ac-4725-b940-5e4fed383d30 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:05.777808 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6590a3ee-a2ac-4725-b940-5e4fed383d30 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:05.778247 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-6590a3ee-a2ac-4725-b940-5e4fed383d30 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:05.781087 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-6654235b-2a66-4816-a44c-23192e207bbd req-e0668284-951f-46d9-929e-b5ba14317e8a service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:05.781520 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-6654235b-2a66-4816-a44c-23192e207bbd req-e0668284-951f-46d9-929e-b5ba14317e8a service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:05.792788 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-6654235b-2a66-4816-a44c-23192e207bbd req-e0668284-951f-46d9-929e-b5ba14317e8a service nova] Creating event network-changed:64f13744-49dc-4efc-923d-e507c7abd6bf for instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 on hv-cinder-82413 Jan 11 14:30:05.798493 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-6654235b-2a66-4816-a44c-23192e207bbd req-e0668284-951f-46d9-929e-b5ba14317e8a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031632 Jan 11 14:30:05.799770 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 750/1488] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:30:05.804891 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-6590a3ee-a2ac-4725-b940-5e4fed383d30 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Going to try to terminate instance {{(pid=116475) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 14:30:05.884125 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-6590a3ee-a2ac-4725-b940-5e4fed383d30 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "DELETE /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 204 len: 0 microversion: 2.1 time: 0.119241 Jan 11 14:30:05.885639 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 739/1489] 10.222.0.49 () {58 vars in 1238 bytes} [Tue Jan 11 14:30:05 2022] DELETE /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 14:30:05.895448 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-9f51753f-e750-43bc-a6b2-56401b0baea6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:30:05.896174 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-9f51753f-e750-43bc-a6b2-56401b0baea6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:30:05.902728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f51753f-e750-43bc-a6b2-56401b0baea6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:05.902728 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f51753f-e750-43bc-a6b2-56401b0baea6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:05.904099 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f51753f-e750-43bc-a6b2-56401b0baea6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:05.904543 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-9f51753f-e750-43bc-a6b2-56401b0baea6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:06.046488 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.policy [None req-9f51753f-e750-43bc-a6b2-56401b0baea6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116474) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:30:06.053779 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-9f51753f-e750-43bc-a6b2-56401b0baea6 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1566 microversion: 2.1 time: 0.163695 Jan 11 14:30:06.054348 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 751/1490] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:30:05 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:30:07.071893 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-ede462c6-bc44-4624-82bd-ec9a8e3404f9 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:30:07.072620 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-ede462c6-bc44-4624-82bd-ec9a8e3404f9 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:30:07.079060 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ede462c6-bc44-4624-82bd-ec9a8e3404f9 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:07.079541 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ede462c6-bc44-4624-82bd-ec9a8e3404f9 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:07.080403 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ede462c6-bc44-4624-82bd-ec9a8e3404f9 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:07.080843 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-ede462c6-bc44-4624-82bd-ec9a8e3404f9 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:07.218447 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-ede462c6-bc44-4624-82bd-ec9a8e3404f9 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:30:07.226302 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-ede462c6-bc44-4624-82bd-ec9a8e3404f9 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1447 microversion: 2.1 time: 0.158833 Jan 11 14:30:07.226865 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 740/1491] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:30:07 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:30:08.083401 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [req-ec98c901-988f-43e7-88ed-4318ca14b560 req-b5acb3ad-d300-488e-9425-c2a3aafe8610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab8a6c-2c89-43b7-9554-1513f3ff0ee9", "name": "network-vif-deleted", "tag": "64f13744-49dc-4efc-923d-e507c7abd6bf"}]} {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 14:30:08.084991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 14:30:08.084991 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: warnings.warn(msg) Jan 11 14:30:08.091742 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-ec98c901-988f-43e7-88ed-4318ca14b560 req-b5acb3ad-d300-488e-9425-c2a3aafe8610 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:08.092197 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [req-ec98c901-988f-43e7-88ed-4318ca14b560 req-b5acb3ad-d300-488e-9425-c2a3aafe8610 service nova] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:08.102574 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.compute.server_external_events [req-ec98c901-988f-43e7-88ed-4318ca14b560 req-b5acb3ad-d300-488e-9425-c2a3aafe8610 service nova] Creating event network-vif-deleted:64f13744-49dc-4efc-923d-e507c7abd6bf for instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 on hv-cinder-82413 Jan 11 14:30:08.107761 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [req-ec98c901-988f-43e7-88ed-4318ca14b560 req-b5acb3ad-d300-488e-9425-c2a3aafe8610 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097755 Jan 11 14:30:08.108320 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 752/1492] 10.222.0.49 () {64 vars in 1317 bytes} [Tue Jan 11 14:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 14:30:08.243896 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-80f1801a-bf68-4de2-9bec-a624487e3794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:30:08.244437 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.compute.api [None req-80f1801a-bf68-4de2-9bec-a624487e3794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116475) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:30:08.251187 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80f1801a-bf68-4de2-9bec-a624487e3794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:08.251672 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80f1801a-bf68-4de2-9bec-a624487e3794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:08.252453 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80f1801a-bf68-4de2-9bec-a624487e3794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:08.252892 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG oslo_concurrency.lockutils [None req-80f1801a-bf68-4de2-9bec-a624487e3794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:08.317276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.policy [None req-80f1801a-bf68-4de2-9bec-a624487e3794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4f33e6ff574fcebecd104a8a5aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802231c203874b75b82b8b9358e6f61d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116475) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 14:30:08.325507 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-80f1801a-bf68-4de2-9bec-a624487e3794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 200 len: 1219 microversion: 2.1 time: 0.085329 Jan 11 14:30:08.327107 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 741/1493] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:30:08 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 14:30:09.342473 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '>' {{(pid=116474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:30:09.343169 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.compute.api [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] [instance: 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9] Fetching instance by UUID {{(pid=116474) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 14:30:09.349653 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:09.350104 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:09.350879 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 14:30:09.351314 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG oslo_concurrency.lockutils [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Lock "bc1cee38-301e-4e07-ba65-d2dc69c9d82f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 14:30:09.364061 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.wsgi [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] HTTP exception thrown: Instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 could not be found. Jan 11 14:30:09.364666 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: DEBUG nova.api.openstack.wsgi [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Returning 404 to user: Instance 61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 could not be found. {{(pid=116474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 14:30:09.365501 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO nova.api.openstack.requestlog [None req-395b5c57-bfc2-46d2-8a5a-bd610b66e55c tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9" status: 404 len: 111 microversion: 2.1 time: 0.027140 Jan 11 14:30:09.366013 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: [pid: 116474|app: 0|req: 753/1494] 10.222.0.49 () {58 vars in 1235 bytes} [Tue Jan 11 14:30:09 2022] GET /compute/v2.1/servers/61ab8a6c-2c89-43b7-9554-1513f3ff0ee9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 14:30:09.518806 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: DEBUG nova.api.openstack.wsgi [None req-7cdee59e-a9a1-429c-a5fc-e80960972794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] Calling method '.version_select at 0x7fba9145f310>' {{(pid=116475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 14:30:09.547058 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO nova.api.openstack.requestlog [None req-7cdee59e-a9a1-429c-a5fc-e80960972794 tempest-TestShelveInstance-838504305 tempest-TestShelveInstance-838504305-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1394274626" status: 202 len: 0 microversion: 2.1 time: 0.032195 Jan 11 14:30:09.548218 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: [pid: 116475|app: 0|req: 742/1495] 10.222.0.49 () {58 vars in 1253 bytes} [Tue Jan 11 14:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1394274626 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 14:30:27.360076 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:30:27.360693 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:30:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:31:22.584968 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:31:22.585596 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: Tue Jan 11 14:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:31:26.613963 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:31:26.614585 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:31:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:33:05.869807 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:33:05.870383 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: Tue Jan 11 14:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:33:23.445541 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:33:23.446111 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:33:23.814831 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:33:23.815276 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: Tue Jan 11 14:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:33:47.370275 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:33:47.370915 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:34:42.594229 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:34:42.594848 dv-cinder-824131-3-iscsi devstack@n-api.service[116475]: Tue Jan 11 14:34:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 14:34:46.621686 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 14:34:46.622303 dv-cinder-824131-3-iscsi devstack@n-api.service[116474]: Tue Jan 11 14:34:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!